2020-04-28T12:26:33.173 INFO:root:teuthology version: 1.0.0-8b924f7 2020-04-28T12:26:33.173 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.nnlr6r1p.tmp -- --verbose --lock --description rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} --name teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi --block --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003 2020-04-28T12:26:33.213 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:26:33.296 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003 branch: octopus description: rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} email: ceph-qa@ceph.io first_in_suite: false job_id: '4990003' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: octopus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 rgw max chunk size: 4194304 rgw obj stripe size: 6291456 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1999 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 rgw: compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 sleep_before_teardown: 0 suite: rgw suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_rgw_throttle.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 teuthology_branch: py2 tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.22147 2020-04-28T12:26:33.296 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-04-28T12:26:33.297 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-04-28T12:26:33.297 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-28T12:26:33.299 INFO:teuthology.task.internal:Checking packages... 2020-04-28T12:26:33.331 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a8c125c7d78f5cd973863993d258cd717ade4c99' 2020-04-28T12:26:33.332 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-28T12:26:33.332 INFO:teuthology.packaging:ref: None 2020-04-28T12:26:33.332 INFO:teuthology.packaging:tag: None 2020-04-28T12:26:33.332 INFO:teuthology.packaging:branch: octopus 2020-04-28T12:26:33.332 INFO:teuthology.packaging:sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:26:33.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-04-28T12:26:33.978 INFO:teuthology.task.internal:Found packages for ceph version 15.2.1-150.gfcb0536 2020-04-28T12:26:33.979 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-28T12:26:33.991 INFO:teuthology.task.internal:no buildpackages task found 2020-04-28T12:26:33.991 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-28T12:26:34.005 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-28T12:26:34.005 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:26:34.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:26:44.066 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:26:54.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:27:04.098 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:27:14.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:27:24.131 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:27:34.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:27:44.163 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:27:54.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:28:04.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:28:14.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:28:24.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:28:34.234 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:28:44.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:28:54.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:04.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:14.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:24.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:34.335 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:44.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:29:54.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:30:04.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:30:14.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:30:24.419 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_teuthology@teuthology', 'description': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003', 'machine_type': 'smithi'} 2020-04-28T12:30:24.439 DEBUG:teuthology.lock.ops:locked ubuntu@smithi092.front.sepia.ceph.com, ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:30:24.498 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:30:24.707 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.1 2020-04-28T12:30:24.712 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.1 2020-04-28T12:30:25.050 INFO:teuthology.orchestra.console:Power off smithi092 2020-04-28T12:30:25.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:30:25.067 INFO:teuthology.orchestra.console:Power off smithi138 2020-04-28T12:30:25.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:30:25.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:25.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:25.201 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2020-04-28T12:30:25.223 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2020-04-28T12:30:25.302 INFO:teuthology.orchestra.console:Power on smithi092 2020-04-28T12:30:25.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:30:25.324 INFO:teuthology.orchestra.console:Power on smithi138 2020-04-28T12:30:25.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:30:25.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:25.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:29.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:29.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:29.585 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2020-04-28T12:30:29.687 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2020-04-28T12:30:33.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:30:33.693 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2020-04-28T12:30:33.794 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2020-04-28T12:33:00.721 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:09.811 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:18.868 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:19.881 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:27.923 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:28.944 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:36.983 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:38.000 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:46.067 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:47.059 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:55.123 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:56.112 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:04.179 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:05.168 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:14.227 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:23.283 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:32.339 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:34:36.003 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.369 INFO:teuthology.orchestra.run.smithi138:> hostname 2020-04-28T12:34:36.390 INFO:teuthology.orchestra.run.smithi138.stdout:smithi095 2020-04-28T12:34:36.390 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.449 INFO:teuthology.orchestra.run.smithi138:> grep smithi095 /etc/hosts 2020-04-28T12:34:36.503 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.95 smithi095.front.sepia.ceph.com smithi095 2020-04-28T12:34:36.504 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.557 INFO:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2020-04-28T12:34:36.679 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.692 INFO:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi095/smithi138/g' /etc/hosts 2020-04-28T12:34:36.760 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.812 INFO:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.95/172.21.15.138/g' /etc/hosts 2020-04-28T12:34:36.881 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:36.934 INFO:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi095/smithi138/g' /etc/hostname 2020-04-28T12:34:37.000 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:34:37.053 INFO:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2020-04-28T12:34:37.120 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2020-04-28T12:34:37.122 DEBUG:teuthology.parallel:result is None 2020-04-28T12:35:04.199 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:04.583 INFO:teuthology.orchestra.run.smithi092:> hostname 2020-04-28T12:35:04.637 INFO:teuthology.orchestra.run.smithi092.stdout:smithi095 2020-04-28T12:35:04.637 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:04.691 INFO:teuthology.orchestra.run.smithi092:> grep smithi095 /etc/hosts 2020-04-28T12:35:04.745 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.95 smithi095.front.sepia.ceph.com smithi095 2020-04-28T12:35:04.745 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:04.799 INFO:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2020-04-28T12:35:04.915 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:04.928 INFO:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi095/smithi092/g' /etc/hosts 2020-04-28T12:35:04.997 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:05.050 INFO:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.95/172.21.15.92/g' /etc/hosts 2020-04-28T12:35:05.118 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:05.171 INFO:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi095/smithi092/g' /etc/hostname 2020-04-28T12:35:05.240 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:05.294 INFO:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2020-04-28T12:35:05.361 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2020-04-28T12:35:05.363 DEBUG:teuthology.parallel:result is None 2020-04-28T12:35:05.491 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2020-04-28T12:35:05.492 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:35:05.509 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2020-04-28T12:35:05.509 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:35:05.525 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:35:05.526 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:35:05.598 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:05.768 INFO:teuthology.orchestra.run.smithi092:> uname -m 2020-04-28T12:35:05.822 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2020-04-28T12:35:05.822 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:05.875 INFO:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2020-04-28T12:35:05.929 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Linux" 2020-04-28T12:35:05.929 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8 (Core)" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2020-04-28T12:35:05.930 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:35:05.931 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:35:05.932 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:05.932 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2020-04-28T12:35:05.948 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:35:05.949 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:35:06.032 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:06.201 INFO:teuthology.orchestra.run.smithi138:> uname -m 2020-04-28T12:35:06.256 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2020-04-28T12:35:06.256 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:06.309 INFO:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2020-04-28T12:35:06.362 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Linux" 2020-04-28T12:35:06.362 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8 (Core)" 2020-04-28T12:35:06.362 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:35:06.363 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:35:06.364 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:06.365 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2020-04-28T12:35:06.378 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-28T12:35:06.410 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz1Jh9Jh56Vg6ly+8sbX+1hnXu6WlArb4GmwsUJkX5FcXAU1PxmHbOxmtmTtC30rmLGJwAyF+IqPdOKhqrowElO2KIl9E0AW3Llqo0BlbDBOI8Q0oylG7xhEJbhmsaI2LACo/lpNk18QVAfi4iPlYqW7honrZcjH6hq6cPn31OQhN2Jl47b0pFOj2/hQ4kV1hGgkwEixtX9CEBdqb6RZo/6cwcDOE07rzay7RoymH/yzCmLUwOX6K4BLkp63NymnxD82S4gArv/bULIG0zcjkgj8767VMX/d2R3DUOkwcNG49ELn7aYQjVEGRN2lL6iFaYF+AehCXGtwCK4Wx6vE1UH873+uqjdRIPXsDdMgUjCgtaE91mtwp2MkC41qf+HpOTwAjANRYLjk/X8Pq5rSZSoh42WYDdVZKu/BFCFAnWnNkqaPgXw/ku99DR7Tpw0Wly4/Md8bJyep74/hHGCa+qf5DPx9GcffI2FlEYo8UXQM0rwnF62NEfElxwrNZlS/U= smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjsr/4cs5WC2J5qFBSBcR1LypTlpHUu/Up/fZmtCZ1+CUNz/1En6yyTsnwYaO/KMIlbHiTVtnltx1CMUJknsNAhFLz7OnoXUeIxcFUeFeHZhlPO9gTBTHnBq082KeSQX449EuA880HhrJC9KWE73TPHh++tivl/rdHRnb1a8tfbpfXVs89TTCK21fhC8NDSIgm/2J8BwRBbzfFBDOgFgbK4uf/OXXGxe7JIoFDRuUzpb2Nrw+6dFoj4DyDFDgOkHR09lVmIVZWaFeGGA2jHkEwW38YhSCj3AIoqmCXKar/cGc9ZvPygxKEwVlJTo1eUXTrvfheD0l8QGz+Xzx4KpLwIwc3XSO42cp8h0fma4LtEai2kotEA8SqG9+g6MaqrH9hFxGiMC154cWJwfxml7noZpF/pKSGIvxN9IMMOUsEmgeMRuRoYCN6w+JUy03cTYLFjQSoxCayamUvF0ERn8WuIFOH3/w6gsyde1B0k9AyYLaK+r6SrTaIbDFjnSbGxxE= 2020-04-28T12:35:06.410 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:35:06.461 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-28T12:35:06.468 INFO:teuthology.task.internal:Saving configuration 2020-04-28T12:35:06.487 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-28T12:35:06.497 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-28T12:35:06.513 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:30:24.425191', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi092.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGs2G7Vr1SxswtBORxGmC7V35nRktEG37MWPUFSRSCh2OVaBkB+L9tExuI0vU1CzvuFDq/dE1w9HLu/0diWJPQU=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003'} 2020-04-28T12:35:06.527 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:30:24.425155', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi138.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKOujJbf+oPxM6xA1XN/kGVH7S/jMM8q5iiWA+ZhI/klVguwMrkvcbOfPqWuLIZpVbayYgHnpAImv7I3UnllLt0=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003'} 2020-04-28T12:35:06.527 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-28T12:35:06.538 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:35:06.538 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:35:06.538 INFO:teuthology.run_tasks:Running task console_log... 2020-04-28T12:35:06.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:35:06.638 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-28T12:35:06.722 INFO:teuthology.task.internal:Opening connections... 2020-04-28T12:35:06.722 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:35:06.723 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:35:06.795 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:35:06.796 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:35:06.866 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-28T12:35:06.877 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:06.915 INFO:teuthology.orchestra.run.smithi138:> uname -m 2020-04-28T12:35:06.969 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2020-04-28T12:35:06.969 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:07.022 INFO:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2020-04-28T12:35:07.075 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Linux" 2020-04-28T12:35:07.075 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8 (Core)" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:35:07.076 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:35:07.077 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:35:07.078 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:07.078 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2020-04-28T12:35:07.099 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.114 INFO:teuthology.orchestra.run.smithi092:> uname -m 2020-04-28T12:35:07.167 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2020-04-28T12:35:07.167 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.217 INFO:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Linux" 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8 (Core)" 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2020-04-28T12:35:07.269 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:07.270 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:35:07.271 INFO:teuthology.orchestra.run.smithi092.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:35:07.271 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:35:07.271 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:35:07.271 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:07.271 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2020-04-28T12:35:07.284 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-28T12:35:07.304 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-28T12:35:07.314 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-28T12:35:07.314 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.328 INFO:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:35:07.367 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:07.381 INFO:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:35:07.435 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-28T12:35:07.445 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-28T12:35:07.445 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.458 INFO:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:35:07.499 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:07.512 INFO:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:35:07.571 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-28T12:35:07.612 INFO:teuthology.run_tasks:Running task kernel... 2020-04-28T12:35:07.630 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'node-exporter.b': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'node-exporter.a': {'sha1': 'distro', 'kdb': True}, 'prometheus.a': {'sha1': 'distro', 'kdb': True}} 2020-04-28T12:35:07.630 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-28T12:35:07.631 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.644 INFO:teuthology.orchestra.run.smithi092:> uname -r 2020-04-28T12:35:07.694 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:07.695 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:07.695 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:07.745 INFO:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2020-04-28T12:35:12.538 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-04-28T12:35:13.783 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-04-28T12:35:14.202 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:35:14.341 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for ceph-el8 owned by ktdreyer 495 kB/s | 47 kB 00:00 2020-04-28T12:35:14.668 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 23 MB/s | 6.4 MB 00:00 2020-04-28T12:35:16.060 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-28T12:35:16.963 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:35:16.963 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:35:17.104 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:35:17.105 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:35:17.105 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:35:17.241 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:17.268 INFO:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:35:17.708 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Apr 2020 12:35:16 PM UTC. 2020-04-28T12:35:18.089 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:35:18.205 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalling: 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:18.206 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 1.5 M 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 0 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stdout:Is this ok [y/N]: 2020-04-28T12:35:18.207 INFO:teuthology.orchestra.run.smithi092.stderr:Operation aborted. 2020-04-28T12:35:18.208 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:18.221 INFO:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2020-04-28T12:35:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:35:16 PM UTC. 2020-04-28T12:35:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:35:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.996 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalling: 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:35:18.997 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 1.5 M 2020-04-28T12:35:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 0 2020-04-28T12:35:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:35:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 27 MB/s | 1.5 MB 00:00 2020-04-28T12:35:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:Total 27 MB/s | 1.5 MB 00:00 2020-04-28T12:35:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:35:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:35:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:35:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:35:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:35:19.420 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:35:19.627 INFO:teuthology.orchestra.run.smithi092.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:35:19.627 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:19.860 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:19.860 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:35:20.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:20.182 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:20.182 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalled: 2020-04-28T12:35:20.182 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:20.182 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:35:20.182 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:35:20.276 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:20.329 INFO:teuthology.orchestra.run.smithi092:> rpm -q kernel --last | head -n 1 2020-04-28T12:35:20.436 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:35:19 PM UTC 2020-04-28T12:35:20.437 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:20.437 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:35:20.438 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:20.454 INFO:teuthology.orchestra.run.smithi138:> uname -r 2020-04-28T12:35:20.510 INFO:teuthology.orchestra.run.smithi138.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:20.510 INFO:teuthology.task.kernel:Running kernel on smithi138: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:20.510 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:20.565 INFO:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2020-04-28T12:35:23.444 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-04-28T12:35:24.619 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:35:25.042 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:35:25.187 INFO:teuthology.orchestra.run.smithi138.stdout:Copr repo for ceph-el8 owned by ktdreyer 464 kB/s | 47 kB 00:00 2020-04-28T12:35:25.506 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 24 MB/s | 6.4 MB 00:00 2020-04-28T12:35:26.816 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-04-28T12:35:27.745 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:35:27.745 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:35:27.888 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:35:27.889 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:35:27.889 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:35:28.004 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:28.057 INFO:teuthology.orchestra.run.smithi138:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:35:28.494 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:35:26 PM UTC. 2020-04-28T12:35:28.860 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:35:28.861 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:28.861 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:28.861 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:28.861 INFO:teuthology.orchestra.run.smithi138.stdout:Reinstalling: 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 1.5 M 2020-04-28T12:35:28.862 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 0 2020-04-28T12:35:28.863 INFO:teuthology.orchestra.run.smithi138.stderr:Operation aborted. 2020-04-28T12:35:28.956 INFO:teuthology.orchestra.run.smithi138.stdout:Is this ok [y/N]: 2020-04-28T12:35:28.956 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:28.969 INFO:teuthology.orchestra.run.smithi138:> sudo yum reinstall -y kernel || true 2020-04-28T12:35:29.394 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:35:26 PM UTC. 2020-04-28T12:35:29.737 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:35:29.737 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:29.737 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout:Reinstalling: 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:35:29.738 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:29.739 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 1.5 M 2020-04-28T12:35:29.739 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 0 2020-04-28T12:35:29.739 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:35:29.786 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 33 MB/s | 1.5 MB 00:00 2020-04-28T12:35:29.786 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:29.787 INFO:teuthology.orchestra.run.smithi138.stdout:Total 32 MB/s | 1.5 MB 00:00 2020-04-28T12:35:29.815 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:35:29.984 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:35:29.984 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:35:30.032 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:35:30.032 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:35:30.131 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:35:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:35:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:30.533 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:30.534 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout:Reinstalled: 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:35:30.821 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:35:30.923 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:30.936 INFO:teuthology.orchestra.run.smithi138:> rpm -q kernel --last | head -n 1 2020-04-28T12:35:31.033 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:35:30 PM UTC 2020-04-28T12:35:31.035 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:35:31.035 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:35:31.035 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-28T12:35:31.036 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.052 INFO:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:35:31.148 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2020-04-28T12:35:31.162 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-28T12:35:31.162 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.175 INFO:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:35:31.289 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2020-04-28T12:35:31.301 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-28T12:35:31.312 INFO:teuthology.task.internal:Creating test directory... 2020-04-28T12:35:31.312 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.327 INFO:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:35:31.370 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.383 INFO:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:35:31.438 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-28T12:35:31.448 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-28T12:35:31.461 INFO:teuthology.task.internal:Creating archive directory... 2020-04-28T12:35:31.461 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.476 INFO:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:35:31.519 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.532 INFO:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:35:31.595 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-28T12:35:31.606 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-28T12:35:31.606 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.621 INFO:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:35:31.663 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.676 INFO:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:35:31.706 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:35:31.721 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:35:31.744 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:35:31.758 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:35:31.759 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-28T12:35:31.770 INFO:teuthology.task.internal:Configuring sudo... 2020-04-28T12:35:31.770 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.784 INFO:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:35:31.826 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.840 INFO:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:35:31.907 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-28T12:35:31.919 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-28T12:35:31.919 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:31.933 INFO:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:35:31.975 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:31.989 INFO:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:35:32.042 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:32.095 INFO:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:35:32.165 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:32.203 INFO:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:35:32.276 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:32.329 INFO:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:35:32.400 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:32.437 INFO:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:35:32.504 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:32.557 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:35:32.642 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:32.656 INFO:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:35:32.729 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:32.767 INFO:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:35:32.843 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:32.897 INFO:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:35:32.967 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:33.005 INFO:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:35:33.072 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:33.125 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:35:33.209 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:33.262 INFO:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2020-04-28T12:35:33.304 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:33.320 INFO:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2020-04-28T12:35:33.384 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:35:33.441 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:35:33.723 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-28T12:35:33.738 INFO:teuthology.task.internal:Starting timer... 2020-04-28T12:35:33.739 INFO:teuthology.run_tasks:Running task pcp... 2020-04-28T12:35:33.771 INFO:teuthology.run_tasks:Running task selinux... 2020-04-28T12:35:33.786 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-28T12:35:33.786 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:33.800 INFO:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2020-04-28T12:35:33.942 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: [ OK ] 2020-04-28T12:35:33.943 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:33.958 INFO:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2020-04-28T12:35:34.102 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: [ OK ] 2020-04-28T12:35:34.103 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-28T12:35:34.103 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:34.117 INFO:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2020-04-28T12:35:34.176 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2020-04-28T12:35:34.176 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:34.190 INFO:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2020-04-28T12:35:34.257 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2020-04-28T12:35:34.257 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': u'permissive'} 2020-04-28T12:35:34.257 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:34.271 INFO:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:35:34.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:35:34.341 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:34.354 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:35:34.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:35:34.422 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-28T12:35:34.422 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:35:34.435 INFO:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:35:34.514 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:35:34.527 INFO:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:35:34.595 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-28T12:35:34.607 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-04-28T12:35:34.607 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-28T12:35:34.622 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-28T12:35:34.625 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-28T12:35:34.971 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-28T12:35:36.065 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-28T12:35:38.965 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-28T12:35:38.986 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:38 +0000 (0:00:00.060) 0:00:00.060 ********* 2020-04-28T12:35:38.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:38 +0000 (0:00:00.010) 0:00:00.071 ********* 2020-04-28T12:35:40.422 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi092.front.sepia.ceph.com] 2020-04-28T12:35:40.437 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] 2020-04-28T12:35:40.537 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:40 +0000 (0:00:01.539) 0:00:01.611 ********* 2020-04-28T12:35:40.568 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:40 +0000 (0:00:00.030) 0:00:01.642 ********* 2020-04-28T12:35:40.862 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-28T12:35:40.863 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:35:40.865 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:35:40.901 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:40 +0000 (0:00:00.332) 0:00:01.975 ********* 2020-04-28T12:35:40.931 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:40 +0000 (0:00:00.030) 0:00:02.005 ********* 2020-04-28T12:35:41.438 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-28T12:35:41.439 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:35:41.441 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:35:41.479 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.547) 0:00:02.553 ********* 2020-04-28T12:35:41.512 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.032) 0:00:02.586 ********* 2020-04-28T12:35:41.517 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-28T12:35:41.518 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:41.553 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.041) 0:00:02.627 ********* 2020-04-28T12:35:41.559 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:41.596 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.043) 0:00:02.670 ********* 2020-04-28T12:35:41.883 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-28T12:35:41.885 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:35:41.885 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:35:41.924 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.327) 0:00:02.998 ********* 2020-04-28T12:35:41.956 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:41 +0000 (0:00:00.031) 0:00:03.030 ********* 2020-04-28T12:35:42.874 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-28T12:35:42.876 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077341.94-236156214769395/source", "state": "file", "uid": 0} changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077341.97-272077942590391/source", "state": "file", "uid": 0} 2020-04-28T12:35:42.914 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:42 +0000 (0:00:00.958) 0:00:03.988 ********* 2020-04-28T12:35:42.951 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:42 +0000 (0:00:00.036) 0:00:04.025 ********* 2020-04-28T12:35:43.620 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-28T12:35:43.620 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:35:43.622 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-04-28T12:35:43.623 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-04-28T12:35:43.625 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:35:43.762 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-28T12:35:43.769 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-28T12:35:43.950 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:43 +0000 (0:00:00.998) 0:00:05.024 ********* 2020-04-28T12:35:43.983 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:43 +0000 (0:00:00.033) 0:00:05.057 ********* 2020-04-28T12:35:44.612 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi092.front.sepia.ceph.com] 2020-04-28T12:35:44.666 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] 2020-04-28T12:35:44.711 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-28T12:35:44.712 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:44 +0000 (0:00:00.727) 0:00:05.785 ********* 2020-04-28T12:35:44.782 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:44 +0000 (0:00:00.070) 0:00:05.856 ********* 2020-04-28T12:35:45.264 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-28T12:35:45.266 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.165246", "end": "2020-04-28 12:35:45.240296", "rc": 0, "start": "2020-04-28 12:35:45.075050", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:35:45.300 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.518) 0:00:06.374 ********* 2020-04-28T12:35:45.306 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.180708", "end": "2020-04-28 12:35:45.276015", "rc": 0, "start": "2020-04-28 12:35:45.095307", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:35:45.343 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.043) 0:00:06.417 ********* 2020-04-28T12:35:45.505 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-28T12:35:45.506 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006997", "end": "2020-04-28 12:35:45.479517", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:35:45.472520", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:35:45.544 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.200) 0:00:06.618 ********* 2020-04-28T12:35:45.584 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008108", "end": "2020-04-28 12:35:45.554706", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:35:45.546598", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:35:45.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.087) 0:00:06.705 ********* 2020-04-28T12:35:45.668 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.036) 0:00:06.742 ********* 2020-04-28T12:35:45.674 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-28T12:35:45.675 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.718 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.049) 0:00:06.791 ********* 2020-04-28T12:35:45.723 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-28T12:35:45.724 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:35:45.765 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.047) 0:00:06.839 ********* 2020-04-28T12:35:45.769 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:35:45.771 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.815 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.049) 0:00:06.889 ********* 2020-04-28T12:35:45.822 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-28T12:35:45.828 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.862 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.046) 0:00:06.936 ********* 2020-04-28T12:35:45.867 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-28T12:35:45.869 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.906 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.044) 0:00:06.980 ********* 2020-04-28T12:35:45.912 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:35:45.913 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.950 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.044) 0:00:07.024 ********* 2020-04-28T12:35:45.955 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-28T12:35:45.957 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:45.993 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:45 +0000 (0:00:00.042) 0:00:07.067 ********* 2020-04-28T12:35:45.998 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-28T12:35:46.001 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.037 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:46 +0000 (0:00:00.043) 0:00:07.111 ********* 2020-04-28T12:35:46.042 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:35:46.043 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:46 +0000 (0:00:00.042) 0:00:07.154 ********* 2020-04-28T12:35:46.086 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.126 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:46 +0000 (0:00:00.045) 0:00:07.200 ********* 2020-04-28T12:35:46.142 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:35:46.143 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.145 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.155 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:35:46.156 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.201 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:46 +0000 (0:00:00.075) 0:00:07.275 ********* 2020-04-28T12:35:46.211 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.211 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.213 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.214 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.217 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sV 2020-04-28T12:35:46.218 INFO:teuthology.task.ansible.out:gRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+ 2020-04-28T12:35:46.220 INFO:teuthology.task.ansible.out:HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd3886557 2020-04-28T12:35:46.222 INFO:teuthology.task.ansible.out:5ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.232 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.232 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.243 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.244 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.255 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.255 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.266 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.267 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.278 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.278 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.280 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.281 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.293 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.294 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.295 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.306 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.307 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.308 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.319 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.319 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.321 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.322 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.332 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.333 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.334 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.344 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.356 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.357 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.358 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.358 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC 2020-04-28T12:35:46.360 INFO:teuthology.task.ansible.out:4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.371 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.371 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.373 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.374 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.374 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.386 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.387 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.388 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.398 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.399 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.400 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.411 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.411 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.413 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.423 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.424 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.425 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.447 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.450 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.451 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.453 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.454 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.454 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.456 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.456 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.458 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.468 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.469 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.471 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.481 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.482 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.483 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.494 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.495 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.506 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.507 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.508 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.509 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.511 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.521 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.522 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.523 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.533 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.534 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.535 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.537 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.548 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.549 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.549 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.551 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.561 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.562 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.563 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.564 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.574 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.575 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.576 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.576 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.578 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.588 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.589 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.590 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.601 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.602 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.603 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.603 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.615 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.616 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.617 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.619 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.628 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.629 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.630 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.641 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.642 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.643 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.654 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.655 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.666 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.667 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.678 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.679 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.691 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.692 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.693 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.704 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.704 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.716 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.716 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.728 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.729 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.740 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.741 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.752 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.766 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.767 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.778 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.779 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.781 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.791 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.792 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.803 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.804 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.815 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.815 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.829 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.859 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.861 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.882 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.883 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.884 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.895 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.906 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.917 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.918 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.919 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.930 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.931 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.932 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.943 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.951 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.952 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.959 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.960 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.961 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.967 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.970 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.980 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.982 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.983 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:46.983 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.015 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.016 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.018 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.018 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.019 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.072 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.870) 0:00:08.146 ********* 2020-04-28T12:35:47.080 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.082 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.083 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.084 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.085 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.086 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.087 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.089 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.101 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.101 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:35:47.102 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.150 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.077) 0:00:08.224 ********* 2020-04-28T12:35:47.156 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.157 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.159 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.187 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.227 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.076) 0:00:08.301 ********* 2020-04-28T12:35:47.260 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.033) 0:00:08.334 ********* 2020-04-28T12:35:47.266 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:35:47.267 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.306 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.046) 0:00:08.380 ********* 2020-04-28T12:35:47.312 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:35:47.364 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.057) 0:00:08.438 ********* 2020-04-28T12:35:47.369 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-28T12:35:47.371 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.408 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.043) 0:00:08.481 ********* 2020-04-28T12:35:47.414 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.459 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.051) 0:00:08.533 ********* 2020-04-28T12:35:47.465 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-28T12:35:47.465 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.510 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.050) 0:00:08.584 ********* 2020-04-28T12:35:47.515 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:35:47.517 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.553 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.042) 0:00:08.626 ********* 2020-04-28T12:35:47.557 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-28T12:35:47.557 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.595 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.042) 0:00:08.669 ********* 2020-04-28T12:35:47.601 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-28T12:35:47.603 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.659 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.063) 0:00:08.733 ********* 2020-04-28T12:35:47.668 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi092.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.670 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.671 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.673 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.674 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.676 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.677 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.677 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.679 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.680 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.691 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.693 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi092.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.693 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.751 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.091) 0:00:08.825 ********* 2020-04-28T12:35:47.760 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.762 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.763 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.765 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.766 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.768 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.768 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.770 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.780 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.781 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.782 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi092.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.841 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.084) 0:00:08.909 ********* 2020-04-28T12:35:47.842 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.843 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.844 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.845 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.846 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.847 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.849 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.861 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.863 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.872 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.873 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.881 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.882 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.884 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.952 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:47 +0000 (0:00:00.116) 0:00:09.026 ********* 2020-04-28T12:35:47.962 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.963 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.963 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.965 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.975 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.975 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.986 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.987 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.998 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:47.998 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.009 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.010 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.021 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.021 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.032 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.033 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.034 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.045 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.056 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.067 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.068 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.080 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.090 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.091 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.103 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.106 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.114 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.115 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.126 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.127 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:35:48.167 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.214) 0:00:09.241 ********* 2020-04-28T12:35:48.706 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:35:48.745 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.578) 0:00:09.819 ********* 2020-04-28T12:35:48.785 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.040) 0:00:09.859 ********* 2020-04-28T12:35:48.789 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-28T12:35:48.791 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => { "msg": "Host smithi092.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:35:48.831 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.046) 0:00:09.905 ********* 2020-04-28T12:35:48.838 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => { "msg": "Host smithi138.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:35:48.880 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.048) 0:00:09.954 ********* 2020-04-28T12:35:48.889 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi092.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:35:48.928 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.047) 0:00:10.002 ********* 2020-04-28T12:35:48.934 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:35:48.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:48 +0000 (0:00:00.045) 0:00:10.048 ********* 2020-04-28T12:35:48.986 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:35:48.988 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.048) 0:00:10.097 ********* 2020-04-28T12:35:49.029 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.070 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.047) 0:00:10.144 ********* 2020-04-28T12:35:49.338 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:35:49.338 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.072058", "end": "2020-04-28 12:35:49.314363", "rc": 0, "start": "2020-04-28 12:35:49.242305", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:35:49.375 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.304) 0:00:10.449 ********* 2020-04-28T12:35:49.381 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.130565", "end": "2020-04-28 12:35:49.329817", "rc": 0, "start": "2020-04-28 12:35:49.199252", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:35:49.419 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.043) 0:00:10.493 ********* 2020-04-28T12:35:49.424 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-28T12:35:49.424 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.463 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.043) 0:00:10.537 ********* 2020-04-28T12:35:49.468 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.507 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.044) 0:00:10.581 ********* 2020-04-28T12:35:49.512 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:35:49.514 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.550 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.043) 0:00:10.624 ********* 2020-04-28T12:35:49.558 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.595 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.044) 0:00:10.669 ********* 2020-04-28T12:35:49.600 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:35:49.601 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.643 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.047) 0:00:10.716 ********* 2020-04-28T12:35:49.648 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.044) 0:00:10.761 ********* 2020-04-28T12:35:49.693 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:35:49.694 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.735 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.048) 0:00:10.809 ********* 2020-04-28T12:35:49.739 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.042) 0:00:10.852 ********* 2020-04-28T12:35:49.783 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-28T12:35:49.786 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.826 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.047) 0:00:10.900 ********* 2020-04-28T12:35:49.830 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.872 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.045) 0:00:10.946 ********* 2020-04-28T12:35:49.877 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:35:49.878 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.046) 0:00:10.993 ********* 2020-04-28T12:35:49.925 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:49.973 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:49 +0000 (0:00:00.054) 0:00:11.047 ********* 2020-04-28T12:35:49.977 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-28T12:35:49.978 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:49.979 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.020 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.047) 0:00:11.094 ********* 2020-04-28T12:35:50.025 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.026 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.063 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.043) 0:00:11.137 ********* 2020-04-28T12:35:50.069 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-28T12:35:50.070 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.107 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.043) 0:00:11.181 ********* 2020-04-28T12:35:50.113 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.150 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.042) 0:00:11.224 ********* 2020-04-28T12:35:50.154 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:35:50.155 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.198 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.047) 0:00:11.272 ********* 2020-04-28T12:35:50.204 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.042) 0:00:11.314 ********* 2020-04-28T12:35:50.245 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:35:50.245 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.284 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.044) 0:00:11.358 ********* 2020-04-28T12:35:50.290 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.330 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.045) 0:00:11.403 ********* 2020-04-28T12:35:50.335 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-28T12:35:50.337 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.375 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.045) 0:00:11.449 ********* 2020-04-28T12:35:50.380 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.418 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.043) 0:00:11.492 ********* 2020-04-28T12:35:50.431 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:35:50.432 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.467 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.049) 0:00:11.541 ********* 2020-04-28T12:35:50.472 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:50.512 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.045) 0:00:11.586 ********* 2020-04-28T12:35:50.530 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.562 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.050) 0:00:11.636 ********* 2020-04-28T12:35:50.568 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.606 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.043) 0:00:11.680 ********* 2020-04-28T12:35:50.607 INFO:teuthology.task.ansible.out: 2020-04-28T12:35:50.612 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:35:50.614 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.650 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.043) 0:00:11.724 ********* 2020-04-28T12:35:50.884 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.267) 0:00:11.991 ********* 2020-04-28T12:35:50.925 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:35:50.925 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:50.962 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:50 +0000 (0:00:00.045) 0:00:12.036 ********* 2020-04-28T12:35:50.967 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.005 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.079 ********* 2020-04-28T12:35:51.014 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.048 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.121 ********* 2020-04-28T12:35:51.052 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.090 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.164 ********* 2020-04-28T12:35:51.096 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-28T12:35:51.097 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:51.132 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.206 ********* 2020-04-28T12:35:51.136 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:51.173 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.247 ********* 2020-04-28T12:35:51.190 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.043) 0:00:12.290 ********* 2020-04-28T12:35:51.221 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.258 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.332 ********* 2020-04-28T12:35:51.263 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-28T12:35:51.265 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.301 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.375 ********* 2020-04-28T12:35:51.306 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.344 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.043) 0:00:12.418 ********* 2020-04-28T12:35:51.349 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-28T12:35:51.351 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.391 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.046) 0:00:12.465 ********* 2020-04-28T12:35:51.398 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.434 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.508 ********* 2020-04-28T12:35:51.446 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.477 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.042) 0:00:12.550 ********* 2020-04-28T12:35:51.481 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.518 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.592 ********* 2020-04-28T12:35:51.523 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-28T12:35:51.524 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.561 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.043) 0:00:12.635 ********* 2020-04-28T12:35:51.578 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.602 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.676 ********* 2020-04-28T12:35:51.610 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-28T12:35:51.611 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.646 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.043) 0:00:12.719 ********* 2020-04-28T12:35:51.650 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.761 ********* 2020-04-28T12:35:51.694 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:51.732 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.045) 0:00:12.806 ********* 2020-04-28T12:35:51.738 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:35:51.774 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.848 ********* 2020-04-28T12:35:51.778 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:35:51.814 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.039) 0:00:12.888 ********* 2020-04-28T12:35:51.854 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.040) 0:00:12.928 ********* 2020-04-28T12:35:51.858 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-28T12:35:51.860 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.896 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:12.969 ********* 2020-04-28T12:35:51.900 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:51.937 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:51 +0000 (0:00:00.041) 0:00:13.011 ********* 2020-04-28T12:35:52.099 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-28T12:35:52.100 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:35:52.135 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:52 +0000 (0:00:00.198) 0:00:13.209 ********* 2020-04-28T12:35:52.153 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:35:52.188 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:52 +0000 (0:00:00.053) 0:00:13.262 ********* 2020-04-28T12:35:52.628 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-28T12:35:52.629 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:35:52.682 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:35:53.066 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:35:53.116 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:53 +0000 (0:00:00.928) 0:00:14.190 ********* 2020-04-28T12:35:53.143 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:35:53.182 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:53 +0000 (0:00:00.065) 0:00:14.255 ********* 2020-04-28T12:35:53.625 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-28T12:35:53.625 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:35:53.699 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:35:54.108 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:35:54.146 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.964) 0:00:15.220 ********* 2020-04-28T12:35:54.151 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:35:54.196 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.050) 0:00:15.270 ********* 2020-04-28T12:35:54.201 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:35:54.210 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.244 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.047) 0:00:15.318 ********* 2020-04-28T12:35:54.249 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.287 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.043) 0:00:15.361 ********* 2020-04-28T12:35:54.293 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:35:54.295 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.331 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.043) 0:00:15.405 ********* 2020-04-28T12:35:54.337 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.376 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.044) 0:00:15.450 ********* 2020-04-28T12:35:54.384 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-28T12:35:54.385 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.420 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.044) 0:00:15.494 ********* 2020-04-28T12:35:54.426 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.464 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.043) 0:00:15.538 ********* 2020-04-28T12:35:54.469 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:35:54.470 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.507 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.042) 0:00:15.581 ********* 2020-04-28T12:35:54.523 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.549 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.042) 0:00:15.623 ********* 2020-04-28T12:35:54.553 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:35:54.555 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.591 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.041) 0:00:15.665 ********* 2020-04-28T12:35:54.599 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.638 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.045) 0:00:15.710 ********* 2020-04-28T12:35:54.642 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:35:54.642 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.680 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.043) 0:00:15.754 ********* 2020-04-28T12:35:54.686 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.726 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.045) 0:00:15.800 ********* 2020-04-28T12:35:54.732 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:35:54.733 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.770 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.043) 0:00:15.844 ********* 2020-04-28T12:35:54.774 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.815 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.044) 0:00:15.889 ********* 2020-04-28T12:35:54.822 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:35:54.824 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.859 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.044) 0:00:15.933 ********* 2020-04-28T12:35:54.864 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.904 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.045) 0:00:15.978 ********* 2020-04-28T12:35:54.910 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:35:54.910 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.952 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.045) 0:00:16.024 ********* 2020-04-28T12:35:54.956 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:54.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:54 +0000 (0:00:00.046) 0:00:16.071 ********* 2020-04-28T12:35:55.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-28T12:35:55.526 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.321084", "end": "2020-04-28 12:35:55.500324", "rc": 0, "start": "2020-04-28 12:35:55.179240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.378659", "end": "2020-04-28 12:35:55.500310", "rc": 0, "start": "2020-04-28 12:35:55.121651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:35:55.568 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:55 +0000 (0:00:00.571) 0:00:16.642 ********* 2020-04-28T12:35:55.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:55 +0000 (0:00:00.036) 0:00:16.679 ********* 2020-04-28T12:35:56.648 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-28T12:35:56.650 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:35:56.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:01.082) 0:00:17.761 ********* 2020-04-28T12:35:56.694 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:35:56.733 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.046) 0:00:17.807 ********* 2020-04-28T12:35:56.737 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-28T12:35:56.738 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:56.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.044) 0:00:17.852 ********* 2020-04-28T12:35:56.788 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:56.838 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.059) 0:00:17.912 ********* 2020-04-28T12:35:56.843 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-28T12:35:56.844 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:56.885 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.046) 0:00:17.959 ********* 2020-04-28T12:35:56.891 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:56.931 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.046) 0:00:18.005 ********* 2020-04-28T12:35:56.938 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-28T12:35:56.939 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:56.976 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:56 +0000 (0:00:00.044) 0:00:18.050 ********* 2020-04-28T12:35:56.981 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:57.019 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:57 +0000 (0:00:00.042) 0:00:18.092 ********* 2020-04-28T12:35:57.024 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-28T12:35:57.024 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:57.068 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:57 +0000 (0:00:00.049) 0:00:18.142 ********* 2020-04-28T12:35:57.072 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:35:57.111 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:57 +0000 (0:00:00.042) 0:00:18.185 ********* 2020-04-28T12:35:57.528 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:35:57.581 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:57 +0000 (0:00:00.470) 0:00:18.655 ********* 2020-04-28T12:35:57.589 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:35:57.639 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:57 +0000 (0:00:00.058) 0:00:18.713 ********* 2020-04-28T12:35:58.496 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-28T12:35:58.502 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:35:58.535 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:58 +0000 (0:00:00.895) 0:00:19.609 ********* 2020-04-28T12:35:58.563 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:35:58.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:58 +0000 (0:00:00.070) 0:00:19.679 ********* 2020-04-28T12:35:59.021 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi092.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:35:59.114 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:35:59.482 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:35:59.566 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:35:59.940 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:35:59.980 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:35:59 +0000 (0:00:01.374) 0:00:21.054 ********* 2020-04-28T12:36:00.021 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:36:00.064 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:00 +0000 (0:00:00.084) 0:00:21.138 ********* 2020-04-28T12:36:00.179 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-28T12:36:00.180 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:36:00.225 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:00 +0000 (0:00:00.161) 0:00:21.299 ********* 2020-04-28T12:36:00.266 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:36:00.311 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:00 +0000 (0:00:00.084) 0:00:21.384 ********* 2020-04-28T12:36:00.709 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:36:00.710 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:36:00.787 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:36:01.148 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:36:01.222 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:36:01.574 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:36:01.629 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:01.319) 0:00:22.703 ********* 2020-04-28T12:36:01.657 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:36:01.659 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:01.723 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:00.092) 0:00:22.796 ********* 2020-04-28T12:36:01.734 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi138.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:36:01.771 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:00.048) 0:00:22.845 ********* 2020-04-28T12:36:01.777 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:36:01.779 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:36:01.817 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:00.046) 0:00:22.891 ********* 2020-04-28T12:36:01.823 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:36:01.824 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:01.861 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:00.044) 0:00:22.935 ********* 2020-04-28T12:36:01.898 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:36:01.899 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:36:01.934 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:01 +0000 (0:00:00.072) 0:00:23.008 ********* 2020-04-28T12:36:02.023 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-28T12:36:02.025 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:36:02.061 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:02 +0000 (0:00:00.127) 0:00:23.135 ********* 2020-04-28T12:36:02.099 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:36:02.100 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.111 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.132 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.133 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-28T12:36:02.133 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:36:02.133 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:36:02.133 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.175 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:02 +0000 (0:00:00.114) 0:00:23.249 ********* 2020-04-28T12:36:02.217 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:02 +0000 (0:00:00.041) 0:00:23.291 ********* 2020-04-28T12:36:02.266 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.280 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.289 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:02.335 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:02 +0000 (0:00:00.118) 0:00:23.409 ********* 2020-04-28T12:36:03.104 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:36:03.106 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:36:03.150 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.814) 0:00:24.224 ********* 2020-04-28T12:36:03.187 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-28T12:36:03.188 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:03.225 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.074) 0:00:24.299 ********* 2020-04-28T12:36:03.276 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:36:03.277 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:36:03.315 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.090) 0:00:24.389 ********* 2020-04-28T12:36:03.341 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-28T12:36:03.343 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:03.383 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.068) 0:00:24.457 ********* 2020-04-28T12:36:03.711 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-28T12:36:03.713 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:36:03.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.364) 0:00:24.822 ********* 2020-04-28T12:36:03.858 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:36:03.895 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:03 +0000 (0:00:00.146) 0:00:24.968 ********* 2020-04-28T12:36:04.254 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:36:04.254 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:36:04.294 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.399) 0:00:25.368 ********* 2020-04-28T12:36:04.328 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:36:04.330 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:04.340 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:04.395 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.101) 0:00:25.469 ********* 2020-04-28T12:36:04.401 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:36:04.402 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:36:04.443 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.046) 0:00:25.516 ********* 2020-04-28T12:36:04.478 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:36:04.479 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:04.480 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:04.526 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.083) 0:00:25.600 ********* 2020-04-28T12:36:04.616 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:36:04.617 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:36:04.660 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.133) 0:00:25.734 ********* 2020-04-28T12:36:04.749 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:36:04.807 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.146) 0:00:25.881 ********* 2020-04-28T12:36:04.910 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:36:04.912 INFO:teuthology.task.ansible.out:fatal: [smithi092.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-28T12:36:04.952 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:04 +0000 (0:00:00.145) 0:00:26.026 ********* 2020-04-28T12:36:04.981 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-28T12:36:04.982 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:05.029 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:05 +0000 (0:00:00.077) 0:00:26.103 ********* 2020-04-28T12:36:05.068 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:36:05.068 INFO:teuthology.task.ansible.out:fatal: [smithi138.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:36:05.070 INFO:teuthology.task.ansible.out:...ignoring 2020-04-28T12:36:05.119 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:05 +0000 (0:00:00.089) 0:00:26.193 ********* 2020-04-28T12:36:05.145 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-28T12:36:05.147 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:05.190 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:05 +0000 (0:00:00.071) 0:00:26.264 ********* 2020-04-28T12:36:05.511 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-28T12:36:05.512 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:36:05.557 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:05 +0000 (0:00:00.366) 0:00:26.631 ********* 2020-04-28T12:36:05.669 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:36:05.707 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:05 +0000 (0:00:00.149) 0:00:26.781 ********* 2020-04-28T12:36:06.314 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-28T12:36:06.319 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:34:31 UTC", "ActiveEnterTimestampMonotonic": "14586576", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target systemd-tmpfiles-setup.service var-run.mount -.mount network.target nss-lookup.target local-fs.target tmp.mount systemd-journald.socket basic.target sysinit.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:34:31 UTC", "AssertTimestampMonotonic": "14585588", "Before": "shutdown.target getty@tty1.service plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:34:31 UTC", "ConditionTimestampMonotonic": "14585587", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:36:06.322 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2506", "ExecMainStartTimestamp": "Tue 2020-04-28 12:34:31 UTC", "ExecMainStartTimestampMonotonic": "14586547", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:34:31 UTC] ; stop_time=[n/a] ; pid=2506 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:34:31 UTC", "InactiveExitTimestampMonotonic": "14586576", "InvocationID": "11f77b1987a844618ff720b26928b487", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:36:06.325 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2506", "MemoryAccounting": "yes", "MemoryCurrent": "1101824", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:36:06.327 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:34:31 UTC", "StateChangeTimestampMonotonic": "14586576", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:34:31 UTC", "WatchdogTimestampMonotonic": "14586575", "WatchdogUSec": "0"}} ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:34:57 UTC", "ActiveEnterTimestampMonotonic": "14661318", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice local-fs.target systemd-tmpfiles-setup.service var-run.mount systemd-journald.socket sysinit.target nss-lookup.target -.mount network.target tmp.mount basic.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp" 2020-04-28T12:36:06.329 INFO:teuthology.task.ansible.out:: "Tue 2020-04-28 12:34:57 UTC", "AssertTimestampMonotonic": "14660458", "Before": "shutdown.target xdm.service getty@tty1.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:34:57 UTC", "ConditionTimestampMonotonic": "14660458", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2495", "ExecMainStartTimestamp": "Tue 2020-04-28 12:34:57 UTC", "ExecMainStartTimestampMonotonic": "14661293", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ 2020-04-28T12:36:06.331 INFO:teuthology.task.ansible.out: path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:34:57 UTC] ; stop_time=[n/a] ; pid=2495 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:34:57 UTC", "InactiveExitTimestampMonotonic": "14661318", "InvocationID": "f1ce99cccce2472991fc4e6acd0d49c1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "Limi 2020-04-28T12:36:06.332 INFO:teuthology.task.ansible.out:tSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2495", "MemoryAccounting": "yes", "MemoryCurrent": "1150976", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 2020-04-28T12:36:06.334 INFO:teuthology.task.ansible.out: 12:34:57 UTC", "StateChangeTimestampMonotonic": "14661318", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:34:57 UTC", "WatchdogTimestampMonotonic": "14661317", "WatchdogUSec": "0"}} 2020-04-28T12:36:06.359 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:06 +0000 (0:00:00.652) 0:00:27.433 ********* 2020-04-28T12:36:06.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:06 +0000 (0:00:00.033) 0:00:27.467 ********* 2020-04-28T12:36:06.562 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-28T12:36:06.564 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001753", "end": "2020-04-28 12:36:06.531143", "rc": 0, "start": "2020-04-28 12:36:06.529390", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:36:06.608 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:06 +0000 (0:00:00.215) 0:00:27.682 ********* 2020-04-28T12:36:06.615 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001744", "end": "2020-04-28 12:36:06.564027", "rc": 0, "start": "2020-04-28 12:36:06.562283", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:36:06.653 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:06 +0000 (0:00:00.044) 0:00:27.727 ********* 2020-04-28T12:36:07.525 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-28T12:36:07.527 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:36:07.563 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:07 +0000 (0:00:00.909) 0:00:28.637 ********* 2020-04-28T12:36:07.580 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:36:07.616 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:07 +0000 (0:00:00.053) 0:00:28.690 ********* 2020-04-28T12:36:08.469 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-28T12:36:08.471 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:36:08.506 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:08 +0000 (0:00:00.890) 0:00:29.580 ********* 2020-04-28T12:36:08.544 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:36:08.581 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:08 +0000 (0:00:00.074) 0:00:29.655 ********* 2020-04-28T12:36:09.867 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-28T12:36:09.869 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:36:09.905 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:09 +0000 (0:00:01.324) 0:00:30.979 ********* 2020-04-28T12:36:09.911 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:36:09.951 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:09 +0000 (0:00:00.045) 0:00:31.025 ********* 2020-04-28T12:36:26.297 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:36:26.298 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.191168", "end": "2020-04-28 12:36:26.266027", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:36:10.074859", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:36:26.336 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:26 +0000 (0:00:16.385) 0:00:47.410 ********* 2020-04-28T12:36:26.353 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.200190", "end": "2020-04-28 12:36:26.329259", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:36:10.129069", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:36:26.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:26 +0000 (0:00:00.054) 0:00:47.464 ********* 2020-04-28T12:36:26.815 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:36:26.816 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:36:26.853 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:26 +0000 (0:00:00.462) 0:00:47.926 ********* 2020-04-28T12:36:26.879 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:36:26.918 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:26 +0000 (0:00:00.065) 0:00:47.992 ********* 2020-04-28T12:36:27.059 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:36:27.060 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012243", "end": "2020-04-28 12:36:27.036801", "rc": 0, "start": "2020-04-28 12:36:27.024558", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:27.098 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:27 +0000 (0:00:00.180) 0:00:48.172 ********* 2020-04-28T12:36:27.135 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022222", "end": "2020-04-28 12:36:27.112584", "rc": 0, "start": "2020-04-28 12:36:27.090362", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:27.172 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:27 +0000 (0:00:00.073) 0:00:48.245 ********* 2020-04-28T12:36:27.306 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:36:27.307 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002190", "end": "2020-04-28 12:36:27.281245", "rc": 0, "start": "2020-04-28 12:36:27.279055", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:27.344 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:27 +0000 (0:00:00.172) 0:00:48.418 ********* 2020-04-28T12:36:27.383 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.004659", "end": "2020-04-28 12:36:27.353506", "rc": 0, "start": "2020-04-28 12:36:27.348847", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:27.422 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:27 +0000 (0:00:00.078) 0:00:48.496 ********* 2020-04-28T12:36:43.721 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:36:43.722 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.099421", "end": "2020-04-28 12:36:43.691755", "rc": 0, "start": "2020-04-28 12:36:27.592334", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:43.765 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:43 +0000 (0:00:16.343) 0:01:04.839 ********* 2020-04-28T12:36:43.945 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.400410", "end": "2020-04-28 12:36:43.918053", "rc": 0, "start": "2020-04-28 12:36:27.517643", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:43.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:43 +0000 (0:00:00.218) 0:01:05.058 ********* 2020-04-28T12:36:43.993 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:36:44.038 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.053) 0:01:05.112 ********* 2020-04-28T12:36:44.076 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:36:44.076 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:36:44.114 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.075) 0:01:05.188 ********* 2020-04-28T12:36:44.151 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:36:44.153 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:36:44.198 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.084) 0:01:05.272 ********* 2020-04-28T12:36:44.203 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:36:44.204 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:36:44.246 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.047) 0:01:05.320 ********* 2020-04-28T12:36:44.252 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:36:44.254 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:36:44.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.047) 0:01:05.367 ********* 2020-04-28T12:36:44.300 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:36:44.300 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:36:44.343 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.049) 0:01:05.417 ********* 2020-04-28T12:36:44.350 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi092.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:36:44.400 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.056) 0:01:05.473 ********* 2020-04-28T12:36:44.405 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:36:44.406 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:36:44.447 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.047) 0:01:05.521 ********* 2020-04-28T12:36:44.484 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:36:44.485 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:36:44.530 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.083) 0:01:05.604 ********* 2020-04-28T12:36:44.567 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:36:44.568 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:36:44.617 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.081) 0:01:05.685 ********* TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:36:44.618 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:36:44.657 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.045) 0:01:05.731 ********* 2020-04-28T12:36:44.809 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:36:44.856 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.199) 0:01:05.930 ********* 2020-04-28T12:36:44.863 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:36:44.864 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:36:44.909 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.052) 0:01:05.983 ********* 2020-04-28T12:36:44.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:36:44.938 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:44.975 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:44 +0000 (0:00:00.065) 0:01:06.049 ********* 2020-04-28T12:36:45.000 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-28T12:36:45.001 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:45.040 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.064) 0:01:06.113 ********* 2020-04-28T12:36:45.058 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:36:45.060 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:36:45.095 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.056) 0:01:06.169 ********* 2020-04-28T12:36:45.120 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:36:45.122 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:45.155 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.059) 0:01:06.229 ********* 2020-04-28T12:36:45.180 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:45.214 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.059) 0:01:06.288 ********* 2020-04-28T12:36:45.252 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-28T12:36:45.252 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:36:45.290 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.076) 0:01:06.364 ********* 2020-04-28T12:36:45.431 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:36:45.468 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.177) 0:01:06.542 ********* 2020-04-28T12:36:45.852 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:36:45.853 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:36:45.889 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.420) 0:01:06.963 ********* 2020-04-28T12:36:45.916 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:36:45.918 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi092"}, "changed": false} 2020-04-28T12:36:45.953 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:45 +0000 (0:00:00.063) 0:01:07.027 ********* 2020-04-28T12:36:45.954 INFO:teuthology.task.ansible.out: 2020-04-28T12:36:46.018 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:36:46.018 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:36:46.061 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:46 +0000 (0:00:00.108) 0:01:07.135 ********* 2020-04-28T12:36:46.097 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:36:46.099 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi138"}, "changed": false} 2020-04-28T12:36:46.134 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:46 +0000 (0:00:00.073) 0:01:07.208 ********* 2020-04-28T12:36:46.947 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:36:46.948 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi092.front.sepia.ceph.com", "ansible_hostname": "smithi092", "ansible_nodename": "smithi092"}, "changed": true, "name": "smithi092"} changed: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi138.front.sepia.ceph.com", "ansible_hostname": "smithi138", "ansible_nodename": "smithi138"}, "changed": true, "name": "smithi138"} 2020-04-28T12:36:46.991 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:46 +0000 (0:00:00.856) 0:01:08.064 ********* 2020-04-28T12:36:47.028 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:47 +0000 (0:00:00.036) 0:01:08.101 ********* 2020-04-28T12:36:47.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:36:47.465 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:36:47.506 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:47 +0000 (0:00:00.478) 0:01:08.579 ********* 2020-04-28T12:36:47.512 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:36:47.551 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:47 +0000 (0:00:00.045) 0:01:08.625 ********* 2020-04-28T12:36:47.974 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:36:47.975 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:36:48.013 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:48 +0000 (0:00:00.461) 0:01:09.087 ********* 2020-04-28T12:36:48.019 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:36:48.058 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:48 +0000 (0:00:00.045) 0:01:09.132 ********* 2020-04-28T12:36:48.681 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:36:48.682 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:36:48.720 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:48 +0000 (0:00:00.661) 0:01:09.793 ********* 2020-04-28T12:36:48.728 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:36:48.765 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:48 +0000 (0:00:00.044) 0:01:09.838 ********* 2020-04-28T12:36:49.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:36:49.198 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:36:49.234 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.469) 0:01:10.308 ********* 2020-04-28T12:36:49.250 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:36:49.297 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.060) 0:01:10.369 ********* 2020-04-28T12:36:49.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:36:49.437 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:36:49.485 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.189) 0:01:10.559 ********* 2020-04-28T12:36:49.504 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:36:49.543 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.058) 0:01:10.617 ********* 2020-04-28T12:36:49.683 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:36:49.684 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:36:49.720 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.176) 0:01:10.794 ********* 2020-04-28T12:36:49.747 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:36:49.788 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.067) 0:01:10.862 ********* 2020-04-28T12:36:49.940 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:36:49.941 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:36:49.981 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:49 +0000 (0:00:00.193) 0:01:11.055 ********* 2020-04-28T12:36:50.008 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:36:50.048 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:50 +0000 (0:00:00.066) 0:01:11.122 ********* 2020-04-28T12:36:50.448 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:36:50.449 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:36:50.487 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:50 +0000 (0:00:00.439) 0:01:11.561 ********* 2020-04-28T12:36:50.515 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:36:50.553 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:50 +0000 (0:00:00.065) 0:01:11.627 ********* 2020-04-28T12:36:50.954 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:36:50.955 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:36:50.993 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:50 +0000 (0:00:00.440) 0:01:12.067 ********* 2020-04-28T12:36:51.030 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:36:51.071 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:51 +0000 (0:00:00.077) 0:01:12.145 ********* 2020-04-28T12:36:52.790 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:36:52.791 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:36:52.791 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.521253", "end": "2020-04-28 12:36:52.760983", "rc": 0, "start": "2020-04-28 12:36:51.239730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:52.828 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:52 +0000 (0:00:01.757) 0:01:13.902 ********* 2020-04-28T12:36:52.969 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.777575", "end": "2020-04-28 12:36:52.940046", "rc": 0, "start": "2020-04-28 12:36:51.162471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:36:53.008 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:53 +0000 (0:00:00.179) 0:01:14.082 ********* 2020-04-28T12:36:53.369 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:36:53.370 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077412.86-106800395713412/source", "state": "file", "uid": 0} 2020-04-28T12:36:53.570 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077413.04-16179697511192/source", "state": "file", "uid": 0} 2020-04-28T12:36:53.866 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077413.38-268284996212369/source", "state": "file", "uid": 0} 2020-04-28T12:36:54.075 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077413.57-254208118656416/source", "state": "file", "uid": 0} 2020-04-28T12:36:54.380 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077413.88-163957066769872/source", "state": "file", "uid": 0} 2020-04-28T12:36:54.424 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:54 +0000 (0:00:01.415) 0:01:15.497 ********* 2020-04-28T12:36:54.587 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077414.08-278897559871266/source", "state": "file", "uid": 0} 2020-04-28T12:36:54.629 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:54 +0000 (0:00:00.205) 0:01:15.703 ********* 2020-04-28T12:36:54.913 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-28T12:36:54.914 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:36:54.954 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:54 +0000 (0:00:00.325) 0:01:16.028 ********* 2020-04-28T12:36:55.146 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:36:55.187 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:55 +0000 (0:00:00.232) 0:01:16.261 ********* 2020-04-28T12:36:55.444 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:36:55.445 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:36:55.684 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:36:55.897 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:36:56.136 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:36:56.343 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:36:56.385 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:56 +0000 (0:00:01.198) 0:01:17.459 ********* 2020-04-28T12:36:56.593 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:36:56.658 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:56 +0000 (0:00:00.273) 0:01:17.732 ********* 2020-04-28T12:36:56.915 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:36:56.915 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.315802", "end": "2020-04-28 12:36:56.884622", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:36:56.568820", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:36:56.917 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:36:56.954 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:56 +0000 (0:00:00.295) 0:01:18.028 ********* 2020-04-28T12:36:56.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:36:56.982 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.018 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.064) 0:01:18.092 ********* 2020-04-28T12:36:57.020 INFO:teuthology.task.ansible.out: 2020-04-28T12:36:57.055 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:36:57.056 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.066 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.104 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.086) 0:01:18.178 ********* 2020-04-28T12:36:57.131 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:36:57.131 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.168 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.063) 0:01:18.242 ********* 2020-04-28T12:36:57.173 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:36:57.174 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.284805", "end": "2020-04-28 12:36:57.127061", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:36:56.842256", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:36:57.215 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.046) 0:01:18.289 ********* 2020-04-28T12:36:57.220 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:36:57.221 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:36:57.260 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.044) 0:01:18.334 ********* 2020-04-28T12:36:57.264 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:36:57.265 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.044) 0:01:18.379 ********* 2020-04-28T12:36:57.313 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:36:57.315 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.357 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.052) 0:01:18.431 ********* 2020-04-28T12:36:57.362 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:36:57.363 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.364 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.402 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.045) 0:01:18.476 ********* 2020-04-28T12:36:57.408 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:36:57.408 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.448 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.045) 0:01:18.522 ********* 2020-04-28T12:36:57.453 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:36:57.454 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.492 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.043) 0:01:18.566 ********* 2020-04-28T12:36:57.528 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:36:57.530 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:36:57.568 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.076) 0:01:18.642 ********* 2020-04-28T12:36:57.625 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:36:57.627 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.670 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.102) 0:01:18.744 ********* 2020-04-28T12:36:57.676 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:36:57.677 INFO:teuthology.task.ansible.out:fatal: [smithi138.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006466", "end": "2020-04-28 12:36:57.635567", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:36:57.629101", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:36:57.717 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.046) 0:01:18.791 ********* 2020-04-28T12:36:57.722 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:36:57.722 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.763 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.045) 0:01:18.837 ********* 2020-04-28T12:36:57.769 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:36:57.769 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:57.808 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:57 +0000 (0:00:00.044) 0:01:18.882 ********* 2020-04-28T12:36:57.972 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:36:57.974 INFO:teuthology.task.ansible.out:fatal: [smithi092.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006397", "end": "2020-04-28 12:36:57.952793", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:36:57.946396", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:36:58.011 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:58 +0000 (0:00:00.203) 0:01:19.085 ********* 2020-04-28T12:36:58.048 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:36:58.049 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:36:58.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:36:58 +0000 (0:00:00.072) 0:01:19.158 ********* 2020-04-28T12:37:00.172 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:37:00.173 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:37:00.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:00 +0000 (0:00:02.126) 0:01:21.285 ********* 2020-04-28T12:37:00.239 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:37:00.279 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:00 +0000 (0:00:00.067) 0:01:21.353 ********* 2020-04-28T12:37:03.258 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:37:03.259 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:37:03.296 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:03 +0000 (0:00:03.017) 0:01:24.370 ********* 2020-04-28T12:37:03.406 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:37:03.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:03 +0000 (0:00:00.148) 0:01:24.519 ********* 2020-04-28T12:37:08.249 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.739494", "end": "2020-04-28 12:37:08.219824", "rc": 0, "start": "2020-04-28 12:37:03.480330", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 141 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 131 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 50 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 71 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:37:04 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base 2020-04-28T12:37:08.251 INFO:teuthology.task.ansible.out: \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 141 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 131 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 50 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 71 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:37:04 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:37:08.287 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:08 +0000 (0:00:04.842) 0:01:29.361 ********* 2020-04-28T12:37:08.429 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.773487", "end": "2020-04-28 12:37:08.406299", "rc": 0, "start": "2020-04-28 12:37:03.632812", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 145 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 134 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:37:04 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:37:08.431 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 145 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 134 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:37:04 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:37:08.467 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:08 +0000 (0:00:00.179) 0:01:29.541 ********* 2020-04-28T12:37:15.873 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:37:15.909 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:15 +0000 (0:00:07.442) 0:01:36.983 ********* 2020-04-28T12:37:15.946 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:37:15.946 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:15.986 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:15 +0000 (0:00:00.077) 0:01:37.060 ********* 2020-04-28T12:37:16.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:37:16.276 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:37:16.310 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:16 +0000 (0:00:00.323) 0:01:37.384 ********* 2020-04-28T12:37:16.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:37:16.337 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:16.375 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:16 +0000 (0:00:00.064) 0:01:37.449 ********* 2020-04-28T12:37:16.912 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:37:16.913 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:37:16.953 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:16 +0000 (0:00:00.578) 0:01:38.027 ********* 2020-04-28T12:37:16.983 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:37:16.985 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:17.019 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.065) 0:01:38.093 ********* 2020-04-28T12:37:17.338 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-28T12:37:17.340 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target basic.target system.slice polkit.service dbus.socket dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service iptables.service shutdown.target ebtables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:37:17.342 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", 2020-04-28T12:37:17.343 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:37:17.345 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Remove packages] ********************************************** ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:37:17.381 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.361) 0:01:38.454 ********* 2020-04-28T12:37:17.413 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.032) 0:01:38.487 ********* 2020-04-28T12:37:17.451 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:37:17.452 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:17.488 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.074) 0:01:38.562 ********* 2020-04-28T12:37:17.676 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-28T12:37:17.677 INFO:teuthology.task.ansible.out:fatal: [smithi092.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:37:17.715 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.227) 0:01:38.789 ********* 2020-04-28T12:37:17.810 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-28T12:37:17.817 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target dbus.service dbus.socket basic.target system.slice polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service ebtables.service ip6tables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:37:17.818 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", 2020-04-28T12:37:17.820 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:37:17.821 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:37:17.852 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:17 +0000 (0:00:00.136) 0:01:38.926 ********* 2020-04-28T12:37:18.151 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-28T12:37:18.153 INFO:teuthology.task.ansible.out:fatal: [smithi138.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:37:18.188 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.336) 0:01:39.262 ********* 2020-04-28T12:37:18.407 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-28T12:37:18.409 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:37:18.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.256) 0:01:39.519 ********* 2020-04-28T12:37:18.473 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Check for custom repos] *************************************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.509 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.063) 0:01:39.583 ********* 2020-04-28T12:37:18.541 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.031) 0:01:39.614 ********* 2020-04-28T12:37:18.544 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:37:18.588 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.047) 0:01:39.662 ********* 2020-04-28T12:37:18.593 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-28T12:37:18.595 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.633 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.044) 0:01:39.707 ********* 2020-04-28T12:37:18.638 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:37:18.639 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.680 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.047) 0:01:39.754 ********* 2020-04-28T12:37:18.688 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:37:18.725 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.045) 0:01:39.799 ********* 2020-04-28T12:37:18.731 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-28T12:37:18.731 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.771 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.045) 0:01:39.845 ********* 2020-04-28T12:37:18.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:37:18.779 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.823 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.052) 0:01:39.897 ********* 2020-04-28T12:37:18.828 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:37:18.829 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.830 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.866 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.042) 0:01:39.940 ********* 2020-04-28T12:37:18.871 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-28T12:37:18.873 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.909 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.042) 0:01:39.983 ********* 2020-04-28T12:37:18.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:37:18.915 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.953 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.044) 0:01:40.027 ********* 2020-04-28T12:37:18.958 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:37:18.959 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:18.960 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.001 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:18 +0000 (0:00:00.047) 0:01:40.075 ********* 2020-04-28T12:37:19.005 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:37:19.043 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.042) 0:01:40.117 ********* 2020-04-28T12:37:19.048 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:37:19.050 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.091 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.046) 0:01:40.164 ********* 2020-04-28T12:37:19.136 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.143 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.053) 0:01:40.217 ********* 2020-04-28T12:37:19.152 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:37:19.191 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.047) 0:01:40.265 ********* 2020-04-28T12:37:19.197 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:37:19.197 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.237 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.046) 0:01:40.311 ********* 2020-04-28T12:37:19.243 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-28T12:37:19.244 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.292 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.054) 0:01:40.366 ********* 2020-04-28T12:37:19.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-28T12:37:19.299 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.338 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:40.412 ********* 2020-04-28T12:37:19.344 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:37:19.344 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.048) 0:01:40.460 ********* 2020-04-28T12:37:19.394 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:37:19.396 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.432 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:40.506 ********* 2020-04-28T12:37:19.438 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-28T12:37:19.440 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.477 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.044) 0:01:40.551 ********* 2020-04-28T12:37:19.482 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:37:19.482 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.523 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:40.597 ********* 2020-04-28T12:37:19.532 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.565 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.042) 0:01:40.639 ********* 2020-04-28T12:37:19.571 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:37:19.572 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.611 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:40.685 ********* 2020-04-28T12:37:19.618 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:37:19.619 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.655 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.043) 0:01:40.729 ********* 2020-04-28T12:37:19.660 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-28T12:37:19.661 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.699 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.044) 0:01:40.773 ********* 2020-04-28T12:37:19.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:37:19.706 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.745 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:40.819 ********* 2020-04-28T12:37:19.751 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:37:19.752 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.046) 0:01:40.866 ********* 2020-04-28T12:37:19.798 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-28T12:37:19.798 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.842 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.050) 0:01:40.916 ********* 2020-04-28T12:37:19.853 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.893 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.050) 0:01:40.967 ********* 2020-04-28T12:37:19.898 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:37:19.899 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.938 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.045) 0:01:41.012 ********* 2020-04-28T12:37:19.941 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:37:19.942 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:19.981 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:19 +0000 (0:00:00.042) 0:01:41.054 ********* 2020-04-28T12:37:19.986 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-28T12:37:19.986 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.025 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.098 ********* 2020-04-28T12:37:20.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:37:20.030 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.069 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.143 ********* 2020-04-28T12:37:20.076 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:37:20.078 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.112 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.186 ********* 2020-04-28T12:37:20.117 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:37:20.117 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.155 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.042) 0:01:41.229 ********* 2020-04-28T12:37:20.160 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:37:20.161 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.200 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.274 ********* 2020-04-28T12:37:20.205 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-28T12:37:20.205 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.245 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.045) 0:01:41.319 ********* 2020-04-28T12:37:20.251 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:37:20.252 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.289 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.363 ********* 2020-04-28T12:37:20.294 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:37:20.296 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.333 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.407 ********* 2020-04-28T12:37:20.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-28T12:37:20.339 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.376 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.450 ********* 2020-04-28T12:37:20.381 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:37:20.383 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.420 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.494 ********* 2020-04-28T12:37:20.426 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:37:20.426 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.464 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.538 ********* 2020-04-28T12:37:20.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:37:20.470 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.507 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.581 ********* 2020-04-28T12:37:20.513 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:37:20.515 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.551 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.625 ********* 2020-04-28T12:37:20.556 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:37:20.557 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.595 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.669 ********* 2020-04-28T12:37:20.603 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:37:20.605 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.647 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.052) 0:01:41.721 ********* 2020-04-28T12:37:20.652 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:37:20.652 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.691 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.765 ********* 2020-04-28T12:37:20.697 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:37:20.698 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.735 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.043) 0:01:41.809 ********* 2020-04-28T12:37:20.740 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:37:20.742 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.780 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.854 ********* 2020-04-28T12:37:20.785 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:37:20.786 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.898 ********* 2020-04-28T12:37:20.829 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:37:20.830 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.869 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:41.943 ********* 2020-04-28T12:37:20.876 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.915 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.046) 0:01:41.989 ********* 2020-04-28T12:37:20.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:37:20.921 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:20.959 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:20 +0000 (0:00:00.044) 0:01:42.033 ********* 2020-04-28T12:37:20.965 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:37:20.968 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.006 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.046) 0:01:42.080 ********* 2020-04-28T12:37:21.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:37:21.013 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.050 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.043) 0:01:42.124 ********* 2020-04-28T12:37:21.055 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:37:21.056 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.094 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.168 ********* 2020-04-28T12:37:21.099 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:21.100 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.137 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.043) 0:01:42.211 ********* 2020-04-28T12:37:21.143 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:37:21.144 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.179 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.041) 0:01:42.253 ********* 2020-04-28T12:37:21.186 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:37:21.188 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.225 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.045) 0:01:42.299 ********* 2020-04-28T12:37:21.230 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:21.231 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.270 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.344 ********* 2020-04-28T12:37:21.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:37:21.275 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.388 ********* 2020-04-28T12:37:21.319 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:37:21.321 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.358 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.432 ********* 2020-04-28T12:37:21.363 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:37:21.365 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.403 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.477 ********* 2020-04-28T12:37:21.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:37:21.412 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.448 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.045) 0:01:42.522 ********* 2020-04-28T12:37:21.454 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:37:21.454 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.493 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.044) 0:01:42.567 ********* 2020-04-28T12:37:21.499 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:37:21.499 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.542 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.049) 0:01:42.616 ********* 2020-04-28T12:37:21.569 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:37:21.571 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:21.607 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.064) 0:01:42.681 ********* 2020-04-28T12:37:21.706 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:37:21.706 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:37:21.745 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.137) 0:01:42.819 ********* 2020-04-28T12:37:21.823 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:37:21.864 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.119) 0:01:42.938 ********* 2020-04-28T12:37:21.963 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:37:21.965 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:37:22.001 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:21 +0000 (0:00:00.136) 0:01:43.075 ********* 2020-04-28T12:37:22.091 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:37:22.127 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.126) 0:01:43.201 ********* 2020-04-28T12:37:22.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:37:22.208 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:37:22.245 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.117) 0:01:43.319 ********* 2020-04-28T12:37:22.271 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:37:22.273 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.309 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.063) 0:01:43.383 ********* 2020-04-28T12:37:22.335 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:37:22.337 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:37:22.373 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.064) 0:01:43.447 ********* 2020-04-28T12:37:22.407 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.033) 0:01:43.481 ********* 2020-04-28T12:37:22.411 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:37:22.411 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.456 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.046) 0:01:43.528 ********* 2020-04-28T12:37:22.458 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:37:22.459 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.499 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.045) 0:01:43.573 ********* 2020-04-28T12:37:22.503 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:37:22.503 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.543 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.617 ********* 2020-04-28T12:37:22.547 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:37:22.550 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.586 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.660 ********* 2020-04-28T12:37:22.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:37:22.591 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.630 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.704 ********* 2020-04-28T12:37:22.636 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:37:22.636 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.676 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.045) 0:01:43.750 ********* 2020-04-28T12:37:22.681 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:37:22.681 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.721 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.044) 0:01:43.795 ********* 2020-04-28T12:37:22.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:37:22.727 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.765 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.044) 0:01:43.839 ********* 2020-04-28T12:37:22.770 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:37:22.774 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.809 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.883 ********* 2020-04-28T12:37:22.815 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:37:22.816 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.853 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.927 ********* 2020-04-28T12:37:22.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:37:22.858 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.896 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.043) 0:01:43.970 ********* 2020-04-28T12:37:22.901 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:37:22.902 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.938 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.042) 0:01:44.012 ********* 2020-04-28T12:37:22.943 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:37:22.943 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:22.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:22 +0000 (0:00:00.045) 0:01:44.058 ********* 2020-04-28T12:37:22.989 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:37:22.991 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.026 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.100 ********* 2020-04-28T12:37:23.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:37:23.032 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.068 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.142 ********* 2020-04-28T12:37:23.072 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:37:23.074 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.111 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.043) 0:01:44.185 ********* 2020-04-28T12:37:23.116 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:37:23.116 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.226 ********* 2020-04-28T12:37:23.157 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:37:23.158 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.193 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.040) 0:01:44.267 ********* 2020-04-28T12:37:23.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:37:23.199 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.309 ********* 2020-04-28T12:37:23.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:37:23.241 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.278 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.042) 0:01:44.352 ********* 2020-04-28T12:37:23.282 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:37:23.285 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.320 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.394 ********* 2020-04-28T12:37:23.325 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:37:23.326 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.362 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.436 ********* 2020-04-28T12:37:23.366 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:37:23.368 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.404 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.042) 0:01:44.478 ********* 2020-04-28T12:37:23.408 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:37:23.410 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.519 ********* 2020-04-28T12:37:23.449 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:37:23.450 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.486 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.040) 0:01:44.560 ********* 2020-04-28T12:37:23.490 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:37:23.493 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.527 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.040) 0:01:44.601 ********* 2020-04-28T12:37:23.531 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:37:23.531 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.567 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.040) 0:01:44.641 ********* 2020-04-28T12:37:23.571 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:37:23.572 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.613 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.041) 0:01:44.683 ********* 2020-04-28T12:37:23.615 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.654 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.044) 0:01:44.727 ********* 2020-04-28T12:37:23.658 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:37:23.658 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.699 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.045) 0:01:44.773 ********* 2020-04-28T12:37:23.703 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:37:23.712 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.048) 0:01:44.822 ********* 2020-04-28T12:37:23.753 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:37:23.753 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.044) 0:01:44.866 ********* 2020-04-28T12:37:23.797 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:37:23.798 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.838 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.045) 0:01:44.912 ********* 2020-04-28T12:37:23.843 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:37:23.845 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.886 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.045) 0:01:44.957 ********* 2020-04-28T12:37:23.888 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:37:23.888 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.927 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.043) 0:01:45.001 ********* 2020-04-28T12:37:23.934 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:37:23.936 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:23.972 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:23 +0000 (0:00:00.045) 0:01:45.046 ********* 2020-04-28T12:37:23.978 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:37:23.980 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.018 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.045) 0:01:45.092 ********* 2020-04-28T12:37:24.023 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:37:24.024 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.069 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.051) 0:01:45.143 ********* 2020-04-28T12:37:24.075 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:37:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.113 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.043) 0:01:45.187 ********* 2020-04-28T12:37:24.118 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:37:24.118 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.157 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.043) 0:01:45.231 ********* 2020-04-28T12:37:24.164 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:24.166 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:37:24.203 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.045) 0:01:45.277 ********* 2020-04-28T12:37:24.209 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:37:24.209 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.249 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.046) 0:01:45.323 ********* 2020-04-28T12:37:24.255 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:37:24.256 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.257 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi092.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.269 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.270 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.271 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.309 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.059) 0:01:45.383 ********* 2020-04-28T12:37:24.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:37:24.314 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.316 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.359 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.050) 0:01:45.433 ********* 2020-04-28T12:37:24.365 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:24.365 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:37:24.406 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.045) 0:01:45.479 ********* 2020-04-28T12:37:24.442 INFO:teuthology.task.ansible.out: 2020-04-28T12:37:24.443 INFO:teuthology.task.ansible.out:TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi138.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.464 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:37:24.465 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.476 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.486 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.487 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.498 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:37:24.499 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003704", "end": "2020-04-28 12:37:24.478221", "rc": 0, "start": "2020-04-28 12:37:24.474517", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:37:24.501 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:37:24.502 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.541 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.135) 0:01:45.615 ********* 2020-04-28T12:37:24.589 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.047) 0:01:45.663 ********* 2020-04-28T12:37:24.593 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:37:24.594 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.636 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.046) 0:01:45.710 ********* 2020-04-28T12:37:24.672 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-28T12:37:24.674 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.719 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.083) 0:01:45.793 ********* 2020-04-28T12:37:24.725 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:37:24.726 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004571", "end": "2020-04-28 12:37:24.694286", "rc": 0, "start": "2020-04-28 12:37:24.689715", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:37:24.768 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.049) 0:01:45.842 ********* 2020-04-28T12:37:24.773 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-28T12:37:24.774 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.812 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.043) 0:01:45.886 ********* 2020-04-28T12:37:24.817 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:37:24.818 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.860 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.047) 0:01:45.934 ********* 2020-04-28T12:37:24.865 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:37:24.866 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.912 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.051) 0:01:45.986 ********* 2020-04-28T12:37:24.924 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:24.957 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:24 +0000 (0:00:00.044) 0:01:46.030 ********* 2020-04-28T12:37:24.982 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-28T12:37:24.984 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:25.021 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:25 +0000 (0:00:00.064) 0:01:46.095 ********* 2020-04-28T12:37:25.047 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:37:25.048 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:25.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:25 +0000 (0:00:00.063) 0:01:46.158 ********* 2020-04-28T12:37:25.835 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:37:25.836 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:37:25.871 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:25 +0000 (0:00:00.786) 0:01:46.945 ********* 2020-04-28T12:37:25.929 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:37:25.931 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:37:25.967 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:25 +0000 (0:00:00.095) 0:01:47.041 ********* 2020-04-28T12:37:26.024 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:37:26.025 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:37:26.067 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.099) 0:01:47.141 ********* 2020-04-28T12:37:26.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:37:26.105 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item={u'block_used': 12909661, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185447, u'size_available': 930551590912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185447, "block_size": 4096, "block_total": 240095108, "block_used": 12909661, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551590912, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:37:26.142 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.075) 0:01:47.216 ********* 2020-04-28T12:37:26.168 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:37:26.169 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005075", "end": "2020-04-28 12:37:26.145527", "rc": 0, "start": "2020-04-28 12:37:26.140452", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:26.206 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.063) 0:01:47.280 ********* 2020-04-28T12:37:26.243 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:37:26.245 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:26.280 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.074) 0:01:47.354 ********* 2020-04-28T12:37:26.306 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:37:26.344 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.063) 0:01:47.418 ********* 2020-04-28T12:37:26.349 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:37:26.351 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005145", "end": "2020-04-28 12:37:26.314956", "rc": 0, "start": "2020-04-28 12:37:26.309811", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:26.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.045) 0:01:47.463 ********* 2020-04-28T12:37:26.396 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:37:26.398 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LJ4S', u'wwn-0x5000c500918da5aa'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LJ4S', u'wwn': u'0x5000c500918da5aa', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LJ4S-part1', u'wwn-0x5000c500918da5aa-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJ4S", "wwn-0x5000c500918da5aa"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJ4S-part1", "wwn-0x5000c500918da5aa-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LJ4S", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:37:26.399 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918da5aa"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:26.431 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:37:26.432 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'block_used': 12909661, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185447, u'size_available': 930551590912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185447, "block_size": 4096, "block_total": 240095108, "block_used": 12909661, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551590912, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:26.468 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.078) 0:01:47.542 ********* 2020-04-28T12:37:26.493 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:37:26.530 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:26 +0000 (0:00:00.061) 0:01:47.604 ********* 2020-04-28T12:37:26.566 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:37:26.567 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKK0', u'wwn-0x5000c5009293769f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKK0', u'wwn': u'0x5000c5009293769f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKK0-part1', u'wwn-0x5000c5009293769f-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKK0", "wwn-0x5000c5009293769f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKK0-part1", "wwn-0x5000c5009293769f-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKK0", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:37:26.569 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c5009293769f"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:27.931 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-5LAEYl-NKfe-IqKk-F4R2-oG5j-UVxK-lGUBZg', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400QM400BGN', u'nvme-nvme.8086-50484654363230343030514d34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.349132", "end": "2020-04-28 12:37:27.894619", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5LAEYl-NKfe-IqKk-F4R2-oG5j-UVxK-lGUBZg", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QM400BGN", "nvme-nvme.8086-50484654363230343030514d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:26.545487", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:37:27.933 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:28.131 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-FxIYtc-INzl-FmbQ-d7oD-I0fu-QuLJ-0RZtLC', u'nvme-INTEL_SSDPEDMD400G4_CVFT6161003C400BGN', u'nvme-nvme.8086-43564654363136313030334334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.370121", "end": "2020-04-28 12:37:28.095085", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FxIYtc-INzl-FmbQ-d7oD-I0fu-QuLJ-0RZtLC", "nvme-INTEL_SSDPEDMD400G4_CVFT6161003C400BGN", "nvme-nvme.8086-43564654363136313030334334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:26.724964", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:37:28.132 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:29.170 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BUfcg0WyDRgJAlj9UOZGzF4bZsQHdYP3R'], u'uuids': [u'593c39d3-10c2-4f2f-b7be-c2832974837d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.041679", "end": "2020-04-28 12:37:29.138678", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BUfcg0WyDRgJAlj9UOZGzF4bZsQHdYP3R"], "labels": [], "masters": [], "uuids": ["593c39d3-10c2-4f2f-b7be-c2832974837d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:28.096999", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:29.400 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpZwdYqFQZOUP6ICLukUaIcbolftfjtPcT'], u'uuids': [u'ff9cce31-1f92-4021-9a5b-008f038e61dc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.067532", "end": "2020-04-28 12:37:29.360099", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpZwdYqFQZOUP6ICLukUaIcbolftfjtPcT"], "labels": [], "masters": [], "uuids": ["ff9cce31-1f92-4021-9a5b-008f038e61dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:28.292567", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:30.409 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BDGfvcmuFOB2OwJbB7qHyvCkiU0CorZrf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.030087", "end": "2020-04-28 12:37:30.372208", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BDGfvcmuFOB2OwJbB7qHyvCkiU0CorZrf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:29.342121", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:30.650 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp0Z2mZtD2rahV1f3ucQAV7XUK2y9iUBlq'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044450", "end": "2020-04-28 12:37:30.604795", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp0Z2mZtD2rahV1f3ucQAV7XUK2y9iUBlq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:29.560345", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:31.646 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BdOJEw759aaqrjRtH2c0RDBvlMJ7MvRTc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.039565", "end": "2020-04-28 12:37:31.614714", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BdOJEw759aaqrjRtH2c0RDBvlMJ7MvRTc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:30.575149", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:31.898 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpIidJNtqBPditx1I6SrS1RSlAlk72bS0s'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053945", "end": "2020-04-28 12:37:31.862729", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpIidJNtqBPditx1I6SrS1RSlAlk72bS0s"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:30.808784", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:32.918 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BNyCdaD2yd9NIhlxnJBR79pn6MUHVBjQL'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.067279", "end": "2020-04-28 12:37:32.881281", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BNyCdaD2yd9NIhlxnJBR79pn6MUHVBjQL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:31.814002", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:33.149 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QposhWS35V86TbFCHZ8r7xysldssDCWQpR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.045784", "end": "2020-04-28 12:37:33.114302", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QposhWS35V86TbFCHZ8r7xysldssDCWQpR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:32.068518", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:34.181 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BZaKGEbKcIC8104qMXTE78aAc0HqMuoGW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.065138", "end": "2020-04-28 12:37:34.147636", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BZaKGEbKcIC8104qMXTE78aAc0HqMuoGW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:33.082498", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:34.229 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:34 +0000 (0:00:07.699) 0:01:55.303 ********* 2020-04-28T12:37:34.267 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:37:34.268 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LJ4S', u'wwn-0x5000c500918da5aa'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LJ4S', u'wwn': u'0x5000c500918da5aa', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LJ4S-part1', u'wwn-0x5000c500918da5aa-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJ4S", "wwn-0x5000c500918da5aa"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJ4S-part1", "wwn-0x5000c500918da5aa-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LJ4S", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:37:34.270 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918da5aa"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:34.393 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:37:34.393 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp34728J8ySmzh26rR7msFv2x7QEirrMT0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.045142", "end": "2020-04-28 12:37:34.354966", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp34728J8ySmzh26rR7msFv2x7QEirrMT0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:33.309824", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:37:34.438 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:34 +0000 (0:00:00.208) 0:01:55.512 ********* 2020-04-28T12:37:34.476 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:37:34.477 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKK0', u'wwn-0x5000c5009293769f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKK0', u'wwn': u'0x5000c5009293769f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKK0-part1', u'wwn-0x5000c5009293769f-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKK0", "wwn-0x5000c5009293769f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKK0-part1", "wwn-0x5000c5009293769f-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKK0", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:37:34.479 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c5009293769f"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:34.510 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-5LAEYl-NKfe-IqKk-F4R2-oG5j-UVxK-lGUBZg', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400QM400BGN', u'nvme-nvme.8086-50484654363230343030514d34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037167", "end": "2020-04-28 12:37:34.474577", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5LAEYl-NKfe-IqKk-F4R2-oG5j-UVxK-lGUBZg", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QM400BGN", "nvme-nvme.8086-50484654363230343030514d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:34.437410", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:37:34.512 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0345408 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0345408 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:34.711 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-FxIYtc-INzl-FmbQ-d7oD-I0fu-QuLJ-0RZtLC', u'nvme-INTEL_SSDPEDMD400G4_CVFT6161003C400BGN', u'nvme-nvme.8086-43564654363136313030334334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037924", "end": "2020-04-28 12:37:34.684936", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-FxIYtc-INzl-FmbQ-d7oD-I0fu-QuLJ-0RZtLC", "nvme-INTEL_SSDPEDMD400G4_CVFT6161003C400BGN", "nvme-nvme.8086-43564654363136313030334334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:34.647012", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:37:34.713 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0350414 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0350414 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:34.850 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BUfcg0WyDRgJAlj9UOZGzF4bZsQHdYP3R'], u'uuids': [u'593c39d3-10c2-4f2f-b7be-c2832974837d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140163", "end": "2020-04-28 12:37:34.813536", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BUfcg0WyDRgJAlj9UOZGzF4bZsQHdYP3R"], "labels": [], "masters": [], "uuids": ["593c39d3-10c2-4f2f-b7be-c2832974837d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:34.673373", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137624 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137624 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.049 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpZwdYqFQZOUP6ICLukUaIcbolftfjtPcT'], u'uuids': [u'ff9cce31-1f92-4021-9a5b-008f038e61dc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140018", "end": "2020-04-28 12:37:35.017388", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpZwdYqFQZOUP6ICLukUaIcbolftfjtPcT"], "labels": [], "masters": [], "uuids": ["ff9cce31-1f92-4021-9a5b-008f038e61dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:34.877370", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137371 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137371 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.165 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BDGfvcmuFOB2OwJbB7qHyvCkiU0CorZrf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141054", "end": "2020-04-28 12:37:35.137610", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BDGfvcmuFOB2OwJbB7qHyvCkiU0CorZrf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:34.996556", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138536 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138536 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.364 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp0Z2mZtD2rahV1f3ucQAV7XUK2y9iUBlq'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140024", "end": "2020-04-28 12:37:35.339348", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp0Z2mZtD2rahV1f3ucQAV7XUK2y9iUBlq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.199324", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137375 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137375 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.489 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BdOJEw759aaqrjRtH2c0RDBvlMJ7MvRTc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.144217", "end": "2020-04-28 12:37:35.464154", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BdOJEw759aaqrjRtH2c0RDBvlMJ7MvRTc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.319937", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141596 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141596 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.688 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpIidJNtqBPditx1I6SrS1RSlAlk72bS0s'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136879", "end": "2020-04-28 12:37:35.656607", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QpIidJNtqBPditx1I6SrS1RSlAlk72bS0s"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.519728", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134367 s, 858 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134367 s, 858 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:35.830 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BNyCdaD2yd9NIhlxnJBR79pn6MUHVBjQL'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.149746", "end": "2020-04-28 12:37:35.794408", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BNyCdaD2yd9NIhlxnJBR79pn6MUHVBjQL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.644662", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147101 s, 784 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147101 s, 784 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.017 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QposhWS35V86TbFCHZ8r7xysldssDCWQpR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139304", "end": "2020-04-28 12:37:35.986419", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02QposhWS35V86TbFCHZ8r7xysldssDCWQpR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.847115", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136687 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136687 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.153 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BZaKGEbKcIC8104qMXTE78aAc0HqMuoGW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140950", "end": "2020-04-28 12:37:36.116928", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-am0PCFcC0nuUBkYpnWXLAJif437AdR2BZaKGEbKcIC8104qMXTE78aAc0HqMuoGW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:35.975978", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13843 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13843 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.197 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:01.758) 0:01:57.271 ********* 2020-04-28T12:37:36.341 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp34728J8ySmzh26rR7msFv2x7QEirrMT0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138536", "end": "2020-04-28 12:37:36.308391", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Nf8T0dQC4S9JcliFI60a8RpALFOY02Qp34728J8ySmzh26rR7msFv2x7QEirrMT0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:37:36.169855", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135881 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135881 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.383 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.186) 0:01:57.457 ********* 2020-04-28T12:37:36.461 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-28T12:37:36.461 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066899", "end": "2020-04-28 12:37:36.428261", "rc": 0, "start": "2020-04-28 12:37:36.361362", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.498 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.114) 0:01:57.572 ********* 2020-04-28T12:37:36.640 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.055055", "end": "2020-04-28 12:37:36.603911", "rc": 0, "start": "2020-04-28 12:37:36.548856", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.677 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.178) 0:01:57.751 ********* 2020-04-28T12:37:36.733 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:37:36.735 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048641", "end": "2020-04-28 12:37:36.711156", "rc": 0, "start": "2020-04-28 12:37:36.662515", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.784 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.106) 0:01:57.857 ********* 2020-04-28T12:37:36.813 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:37:36.854 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.070) 0:01:57.928 ********* 2020-04-28T12:37:36.882 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-28T12:37:36.883 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:36.924 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.069) 0:01:57.998 ********* 2020-04-28T12:37:36.930 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:37:36.931 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046977", "end": "2020-04-28 12:37:36.890826", "rc": 0, "start": "2020-04-28 12:37:36.843849", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:36.971 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:36 +0000 (0:00:00.046) 0:01:58.044 ********* 2020-04-28T12:37:36.976 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:37:36.979 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.015 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.089 ********* 2020-04-28T12:37:37.020 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:37:37.061 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.046) 0:01:58.135 ********* 2020-04-28T12:37:37.067 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:37:37.068 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.115 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.054) 0:01:58.189 ********* 2020-04-28T12:37:37.122 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.167 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.052) 0:01:58.241 ********* 2020-04-28T12:37:37.172 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.220 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.053) 0:01:58.294 ********* 2020-04-28T12:37:37.227 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:37:37.228 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.268 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.047) 0:01:58.342 ********* 2020-04-28T12:37:37.295 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:37:37.297 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.337 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.068) 0:01:58.411 ********* 2020-04-28T12:37:37.363 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-28T12:37:37.365 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.400 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.062) 0:01:58.474 ********* 2020-04-28T12:37:37.416 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:37:37.416 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:37:37.454 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.054) 0:01:58.528 ********* 2020-04-28T12:37:37.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:37:37.492 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.529 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.074) 0:01:58.603 ********* 2020-04-28T12:37:37.555 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:37:37.556 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.594 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.064) 0:01:58.668 ********* 2020-04-28T12:37:37.598 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:37:37.599 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:37:37.636 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.042) 0:01:58.710 ********* 2020-04-28T12:37:37.641 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:37.642 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.680 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.043) 0:01:58.754 ********* 2020-04-28T12:37:37.686 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:37:37.687 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={u'block_used': 12909661, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185447, u'size_available': 930551590912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185447, "block_size": 4096, "block_total": 240095108, "block_used": 12909661, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551590912, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.724 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.798 ********* 2020-04-28T12:37:37.729 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:37.730 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.769 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.843 ********* 2020-04-28T12:37:37.774 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:37:37.778 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.814 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.888 ********* 2020-04-28T12:37:37.820 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:37:37.821 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.862 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.933 ********* 2020-04-28T12:37:37.864 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:37.865 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.904 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.044) 0:01:58.978 ********* 2020-04-28T12:37:37.909 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:37:37.910 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.952 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.045) 0:01:59.023 ********* 2020-04-28T12:37:37.954 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:37.955 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:37.995 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:37 +0000 (0:00:00.046) 0:01:59.069 ********* 2020-04-28T12:37:38.003 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:37:38.006 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:38.043 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.047) 0:01:59.117 ********* 2020-04-28T12:37:38.049 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:37:38.051 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:38.088 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.045) 0:01:59.162 ********* 2020-04-28T12:37:38.115 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:37:38.116 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:38.152 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.064) 0:01:59.226 ********* 2020-04-28T12:37:38.178 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:37:38.180 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:38.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.063) 0:01:59.290 ********* 2020-04-28T12:37:38.753 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-28T12:37:38.754 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:37:38.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.576) 0:01:59.866 ********* 2020-04-28T12:37:38.797 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:37:38.838 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:38 +0000 (0:00:00.046) 0:01:59.912 ********* 2020-04-28T12:37:39.460 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:37:39.462 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:39.463 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:39.789 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:39.811 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.128 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.160 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.459 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.491 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.793 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.838 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:40 +0000 (0:00:01.999) 0:02:01.911 ********* 2020-04-28T12:37:40.847 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:37:40.890 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:40 +0000 (0:00:00.052) 0:02:01.964 ********* 2020-04-28T12:37:41.046 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:37:41.047 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:37:41.086 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:41 +0000 (0:00:00.196) 0:02:02.160 ********* 2020-04-28T12:37:41.104 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:37:41.144 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:41 +0000 (0:00:00.057) 0:02:02.218 ********* 2020-04-28T12:37:41.150 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:37:41.150 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:41.183 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:41.335 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.368 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.516 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.549 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.706 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.739 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.887 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.932 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:41 +0000 (0:00:00.787) 0:02:03.005 ********* 2020-04-28T12:37:41.938 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:37:41.983 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:41 +0000 (0:00:00.051) 0:02:03.056 ********* 2020-04-28T12:37:42.127 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:37:42.129 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:37:42.164 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:42 +0000 (0:00:00.181) 0:02:03.238 ********* 2020-04-28T12:37:42.180 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:37:42.219 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:42 +0000 (0:00:00.054) 0:02:03.293 ********* 2020-04-28T12:37:42.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-28T12:37:42.224 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:37:42.264 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:42 +0000 (0:00:00.045) 0:02:03.338 ********* 2020-04-28T12:37:42.269 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:37:42.308 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:42 +0000 (0:00:00.044) 0:02:03.382 ********* 2020-04-28T12:37:42.821 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:37:42.822 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:37:42.861 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:42 +0000 (0:00:00.552) 0:02:03.934 ********* 2020-04-28T12:37:43.443 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:37:43.444 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:37:43.484 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.623) 0:02:04.558 ********* 2020-04-28T12:37:43.512 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:37:43.514 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.549 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.065) 0:02:04.623 ********* 2020-04-28T12:37:43.579 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.069) 0:02:04.693 ********* 2020-04-28T12:37:43.646 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:37:43.648 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.684 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.064) 0:02:04.758 ********* 2020-04-28T12:37:43.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:37:43.712 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.762 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.078) 0:02:04.836 ********* 2020-04-28T12:37:43.789 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:37:43.790 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.832 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.069) 0:02:04.906 ********* 2020-04-28T12:37:43.837 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:37:43.838 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:37:43.875 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.042) 0:02:04.949 ********* 2020-04-28T12:37:43.879 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:37:43.881 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.041) 0:02:04.990 ********* 2020-04-28T12:37:43.943 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:37:43.944 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:43.981 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:43 +0000 (0:00:00.064) 0:02:05.055 ********* 2020-04-28T12:37:44.009 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-28T12:37:44.010 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.047 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.066) 0:02:05.121 ********* 2020-04-28T12:37:44.073 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.110 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.062) 0:02:05.184 ********* 2020-04-28T12:37:44.136 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:37:44.137 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.175 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.065) 0:02:05.249 ********* 2020-04-28T12:37:44.191 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:37:44.193 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:37:44.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.064) 0:02:05.314 ********* 2020-04-28T12:37:44.246 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:37:44.247 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.289 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.048) 0:02:05.363 ********* 2020-04-28T12:37:44.294 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:37:44.295 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.335 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.046) 0:02:05.409 ********* 2020-04-28T12:37:44.362 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:37:44.364 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.401 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.065) 0:02:05.475 ********* 2020-04-28T12:37:44.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:37:44.433 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.469 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.067) 0:02:05.542 ********* 2020-04-28T12:37:44.507 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:37:44.515 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.551 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.082) 0:02:05.625 ********* 2020-04-28T12:37:44.577 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:37:44.579 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.621 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.070) 0:02:05.695 ********* 2020-04-28T12:37:44.648 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:37:44.649 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.684 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.062) 0:02:05.758 ********* 2020-04-28T12:37:44.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:37:44.711 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.746 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.061) 0:02:05.820 ********* 2020-04-28T12:37:44.765 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:37:44.799 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.053) 0:02:05.873 ********* 2020-04-28T12:37:44.808 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.844 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.044) 0:02:05.918 ********* 2020-04-28T12:37:44.881 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-28T12:37:44.882 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.916 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.072) 0:02:05.990 ********* 2020-04-28T12:37:44.942 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:37:44.944 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:44.976 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:44 +0000 (0:00:00.059) 0:02:06.050 ********* 2020-04-28T12:37:45.001 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:37:45.003 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:45.036 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.060) 0:02:06.110 ********* 2020-04-28T12:37:45.104 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:37:45.107 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:34:31 UTC", "ActiveEnterTimestampMonotonic": "14549239", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket tmp.mount ntpdate.service -.mount sysinit.target system.slice systemd-tmpfiles-setup.service sntp.service ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:34:30 UTC", "AssertTimestampMonotonic": "13408763", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:34:30 UTC", "ConditionTimestampMonotonic": "13408737", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:37:45.108 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2445", "ExecMainStartTimestamp": "Tue 2020-04-28 12:34:31 UTC", "ExecMainStartTimestampMonotonic": "14487330", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:34:30 UTC", "InactiveExitTimestampMonotonic": "13429588", "InvocationID": "be82991b08854e8f9a7dc5b217a8ba1c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:37:45.110 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2445", "MemoryAccounting": "yes", "MemoryCurrent": "2744320", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:37:45.111 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:34:31 UTC", "StateChangeTimestampMonotonic": "14549239", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:34:31 UTC", "WatchdogTimestampMonotonic": "14487344", "WatchdogUSec": "0"}} 2020-04-28T12:37:45.145 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.108) 0:02:06.218 ********* 2020-04-28T12:37:45.181 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:45.183 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:37:45.221 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.076) 0:02:06.295 ********* 2020-04-28T12:37:45.257 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:45.258 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:37:45.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.072) 0:02:06.367 ********* 2020-04-28T12:37:45.318 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:37:45.320 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:45.353 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.059) 0:02:06.427 ********* 2020-04-28T12:37:45.381 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:45.414 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.061) 0:02:06.488 ********* 2020-04-28T12:37:45.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:37:45.441 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:45.475 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.060) 0:02:06.549 ********* 2020-04-28T12:37:45.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-28T12:37:45.514 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:37:45.558 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.083) 0:02:06.632 ********* 2020-04-28T12:37:45.679 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-28T12:37:45.679 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:37:45.722 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.163) 0:02:06.795 ********* 2020-04-28T12:37:45.863 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:37:45.866 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:34:57 UTC", "ActiveEnterTimestampMonotonic": "14654228", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target tmp.mount ntpd.service system.slice ntpdate.service sntp.service -.mount basic.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:34:56 UTC", "AssertTimestampMonotonic": "13498187", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:34:56 UTC", "ConditionTimestampMonotonic": "13498161", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:37:45.867 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2453", "ExecMainStartTimestamp": "Tue 2020-04-28 12:34:57 UTC", "ExecMainStartTimestampMonotonic": "14612518", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:34:56 UTC", "InactiveExitTimestampMonotonic": "13602654", "InvocationID": "ca63fd60a9954008a804cf525dc852ae", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:37:45.868 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2453", "MemoryAccounting": "yes", "MemoryCurrent": "2478080", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:37:45.870 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:34:57 UTC", "StateChangeTimestampMonotonic": "14654228", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:34:57 UTC", "WatchdogTimestampMonotonic": "14612532", "WatchdogUSec": "0"}} 2020-04-28T12:37:45.904 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.181) 0:02:06.978 ********* 2020-04-28T12:37:45.930 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:45.932 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:37:45.967 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:45 +0000 (0:00:00.063) 0:02:07.041 ********* 2020-04-28T12:37:46.015 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:46.016 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:37:46.057 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.090) 0:02:07.131 ********* 2020-04-28T12:37:46.084 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:37:46.085 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:46.120 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.062) 0:02:07.194 ********* 2020-04-28T12:37:46.146 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:37:46.147 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:46.183 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.063) 0:02:07.257 ********* 2020-04-28T12:37:46.198 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:37:46.199 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:37:46.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.052) 0:02:07.309 ********* 2020-04-28T12:37:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:37:46.241 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:46.285 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.049) 0:02:07.359 ********* 2020-04-28T12:37:46.499 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:37:46.531 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:46 +0000 (0:00:00.246) 0:02:07.605 ********* 2020-04-28T12:37:47.011 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:37:47.011 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:37:47.048 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:47 +0000 (0:00:00.516) 0:02:08.122 ********* 2020-04-28T12:37:47.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:37:47.544 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:37:47.585 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:47 +0000 (0:00:00.536) 0:02:08.658 ********* 2020-04-28T12:37:47.611 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:47.651 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:47 +0000 (0:00:00.066) 0:02:08.725 ********* 2020-04-28T12:37:47.688 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:37:47.689 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:37:47.726 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:47 +0000 (0:00:00.074) 0:02:08.800 ********* 2020-04-28T12:37:47.923 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:37:47.924 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:37:47.959 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:47 +0000 (0:00:00.233) 0:02:09.033 ********* 2020-04-28T12:37:47.984 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-28T12:37:47.986 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.022 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.062) 0:02:09.096 ********* 2020-04-28T12:37:48.047 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-28T12:37:48.049 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:37:48.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.061) 0:02:09.158 ********* 2020-04-28T12:37:48.100 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:37:48.101 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:37:48.138 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.054) 0:02:09.212 ********* 2020-04-28T12:37:48.142 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:37:48.143 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.180 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.042) 0:02:09.254 ********* 2020-04-28T12:37:48.184 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-28T12:37:48.185 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.223 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.042) 0:02:09.297 ********* 2020-04-28T12:37:48.250 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:37:48.252 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:37:48.287 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.063) 0:02:09.361 ********* 2020-04-28T12:37:48.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-28T12:37:48.376 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:37:48.413 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.126) 0:02:09.487 ********* 2020-04-28T12:37:48.486 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:37:48.488 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:37:48.525 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.111) 0:02:09.599 ********* 2020-04-28T12:37:48.552 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-28T12:37:48.553 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.588 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.063) 0:02:09.662 ********* 2020-04-28T12:37:48.615 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:37:48.616 INFO:teuthology.task.ansible.out:changed: [smithi138.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:37:48.618 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi092.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:37:48.654 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.065) 0:02:09.728 ********* 2020-04-28T12:37:48.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.032) 0:02:09.761 ********* 2020-04-28T12:37:48.692 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:37:48.693 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.730 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.042) 0:02:09.804 ********* 2020-04-28T12:37:48.735 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-28T12:37:48.740 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.773 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.043) 0:02:09.847 ********* 2020-04-28T12:37:48.809 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-28T12:37:48.815 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi138.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.823 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.824 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.835 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.872 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.099) 0:02:09.946 ********* 2020-04-28T12:37:48.909 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:37:48.910 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.911 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.922 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.923 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-28T12:37:48.924 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:37:48.925 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:37:48.926 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:48.967 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:48 +0000 (0:00:00.094) 0:02:10.041 ********* 2020-04-28T12:37:48.973 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.013 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.046) 0:02:10.087 ********* 2020-04-28T12:37:49.039 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:49.041 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.066) 0:02:10.154 ********* 2020-04-28T12:37:49.117 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:37:49.119 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.072) 0:02:10.227 ********* 2020-04-28T12:37:49.169 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:37:49.169 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:37:49.206 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.053) 0:02:10.280 ********* 2020-04-28T12:37:49.213 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:37:49.213 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.259 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.052) 0:02:10.332 ********* 2020-04-28T12:37:49.263 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-28T12:37:49.265 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.302 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.043) 0:02:10.376 ********* 2020-04-28T12:37:49.309 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:37:49.310 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.353 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.050) 0:02:10.427 ********* 2020-04-28T12:37:49.359 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-28T12:37:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.361 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.363 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.364 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.402 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.048) 0:02:10.476 ********* 2020-04-28T12:37:49.408 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:37:49.410 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.464 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.060) 0:02:10.536 ********* 2020-04-28T12:37:49.467 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:37:49.468 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.469 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.471 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi092.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.472 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.510 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.048) 0:02:10.584 ********* 2020-04-28T12:37:49.517 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:37:49.518 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.558 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.047) 0:02:10.632 ********* 2020-04-28T12:37:49.563 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:37:49.563 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.046) 0:02:10.679 ********* 2020-04-28T12:37:49.611 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:37:49.611 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.652 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.047) 0:02:10.726 ********* 2020-04-28T12:37:49.657 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:37:49.666 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.697 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.044) 0:02:10.771 ********* 2020-04-28T12:37:49.703 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:37:49.704 INFO:teuthology.task.ansible.out:skipping: [smithi138.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.741 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.043) 0:02:10.815 ********* 2020-04-28T12:37:49.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:37:49.747 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.786 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.045) 0:02:10.860 ********* 2020-04-28T12:37:49.813 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:37:49.842 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.851 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.064) 0:02:10.925 ********* 2020-04-28T12:37:49.877 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:37:49.879 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.918 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.066) 0:02:10.991 ********* 2020-04-28T12:37:49.944 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:37:49.945 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:49.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:49 +0000 (0:00:00.066) 0:02:11.058 ********* 2020-04-28T12:37:49.990 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:37:49.991 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005050", "end": "2020-04-28 12:37:49.933799", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:37:49.928749", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.054 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:37:50.056 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:50.102 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:50 +0000 (0:00:00.108) 0:02:11.167 ********* 2020-04-28T12:37:50.119 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:37:50.121 INFO:teuthology.task.ansible.out:skipping: [smithi092.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:37:50.158 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:50 +0000 (0:00:00.064) 0:02:11.232 ********* 2020-04-28T12:37:50.184 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:37:50.186 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003046", "end": "2020-04-28 12:37:50.125083", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:37:50.122037", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.384 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004919", "end": "2020-04-28 12:37:50.342100", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:37:50.337181", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.385 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002749", "end": "2020-04-28 12:37:50.348124", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:37:50.345375", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.562 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002912", "end": "2020-04-28 12:37:50.526873", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:37:50.523961", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.573 INFO:teuthology.task.ansible.out:ok: [smithi138.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016106", "end": "2020-04-28 12:37:50.542183", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:37:50.526077", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.614 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:50 +0000 (0:00:00.456) 0:02:11.688 ********* 2020-04-28T12:37:50.637 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:37:50.673 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:50 +0000 (0:00:00.059) 0:02:11.747 ********* 2020-04-28T12:37:50.752 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:37:50.753 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002697", "end": "2020-04-28 12:37:50.711928", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:37:50.709231", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.874 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi138.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:37:50.958 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:37:50.959 INFO:teuthology.task.ansible.out:ok: [smithi092.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019424", "end": "2020-04-28 12:37:50.919936", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:37:50.900512", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:37:50.994 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:50 +0000 (0:00:00.321) 0:02:12.068 ********* 2020-04-28T12:37:51.021 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:37:51.056 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:37:51 +0000 (0:00:00.061) 0:02:12.130 ********* 2020-04-28T12:37:51.257 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-28T12:37:51.259 INFO:teuthology.task.ansible.out:changed: [smithi092.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:37:51.359 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-04-28T12:37:51.361 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-28T12:37:51.363 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-04-28T12:37:51.364 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi092.front.sepia.ceph.com : ok=113 changed=34 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi138.front.sepia.ceph.com : ok=113 changed=34 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Tuesday 28 April 2020 12:37:51 +0000 (0:00:00.306) 0:02:12.437 ********* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 16.39s common : nrpe - Load SELinux policy package ---------------------------- 16.34s testnode : Zap all non-root disks --------------------------------------- 7.70s testnode : Install packages --------------------------------------------- 7.44s testnode : Base group workaround for BZ1782899 -------------------------- 4.84s testnode : Ensure ceph dependency packages are not present. ------------- 3.02s testnode : Ensure ceph packages are not present. ------------------------ 2.13s testnode : Create logical volume(s) ------------------------------------- 2.00s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.76s testnode : Rebuild rpmdb ------------------------------------------------ 1.76s 2020-04-28T12:37:51.364 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.54s testnode : Configure local mirrorlists ---------------------------------- 1.42s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.37s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.32s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.32s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.20s common : Install Kerberos Packages (RedHat) ----------------------------- 1.08s ansible-managed : Add authorized keys for the ansible user. ------------- 1.00s 2020-04-28T12:37:51.364 INFO:teuthology.task.ansible.out:common : Config 2020-04-28T12:37:51.366 INFO:teuthology.task.ansible.out:ure local epel mirrorlists ------------------------------- 0.96s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.96s 2020-04-28T12:37:51.642 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2020-04-28T12:37:51.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:37:51.645 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi138.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:37:51.718 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:51.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:37:51.810 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi092.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:37:51.876 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:51.962 INFO:teuthology.run_tasks:Running task clock... 2020-04-28T12:37:51.972 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-28T12:37:51.972 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:51.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:37:51.989 INFO:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:37:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:37:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:37:52.129 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2020-04-28T12:37:52.148 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2020-04-28T12:37:52.162 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:37:52.195 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:37:52.260 INFO:teuthology.orchestra.run.smithi138.stderr:bash: ntpq: command not found 2020-04-28T12:37:52.265 INFO:teuthology.orchestra.run.smithi138.stdout:210 Number of sources = 4 2020-04-28T12:37:52.265 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.266 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:52.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:37:52.280 INFO:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:37:52.355 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:37:52.388 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:37:52.421 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2020-04-28T12:37:52.438 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2020-04-28T12:37:52.454 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:37:52.462 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:37:52.528 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2020-04-28T12:37:52.556 INFO:teuthology.orchestra.run.smithi092.stdout:210 Number of sources = 4 2020-04-28T12:37:52.556 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:37:52.556 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2020-04-28T12:37:52.556 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.557 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.557 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.557 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:37:52.557 INFO:teuthology.run_tasks:Running task install... 2020-04-28T12:37:52.566 DEBUG:teuthology.task.install:project ceph 2020-04-28T12:37:52.567 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}} 2020-04-28T12:37:52.567 DEBUG:teuthology.task.install:config {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:37:52.567 INFO:teuthology.task.install:Using flavor: basic 2020-04-28T12:37:52.573 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-28T12:37:52.573 INFO:teuthology.task.install:extra packages: [] 2020-04-28T12:37:52.574 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:52.588 INFO:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2020-04-28T12:37:52.672 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS 2020-04-28T12:37:52.672 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:37:52.672 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:52.673 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:37:52.673 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:52.686 INFO:teuthology.orchestra.run.smithi092:> sudo lsb_release -is 2020-04-28T12:37:52.725 INFO:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2020-04-28T12:37:52.761 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS 2020-04-28T12:37:52.762 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:37:52.763 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:37:52.763 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:52.800 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS 2020-04-28T12:37:52.801 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:37:52.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:37:52.817 INFO:teuthology.orchestra.run.smithi092:> sudo lsb_release -is 2020-04-28T12:37:52.892 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS 2020-04-28T12:37:52.893 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:37:52.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:37:53.038 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:37:53.039 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:37:53.127 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:37:53.127 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:37:53.240 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:37:53.240 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:53.255 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:37:53.314 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:37:53.314 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:53.328 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:37:53.341 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:37:53.341 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:53.395 INFO:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:37:53.413 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:37:53.413 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:53.464 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:53.465 INFO:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:37:53.518 INFO:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:37:53.533 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:53.586 INFO:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:37:53.600 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:53.655 INFO:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:37:53.683 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:53.721 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2020-04-28T12:37:53.723 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:53.736 INFO:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:37:53.776 INFO:teuthology.orchestra.run.smithi138:> sudo yum clean all 2020-04-28T12:37:53.802 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2020-04-28T12:37:53.803 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:53.857 INFO:teuthology.orchestra.run.smithi092:> sudo yum clean all 2020-04-28T12:37:54.054 INFO:teuthology.orchestra.run.smithi138.stdout:50 files removed 2020-04-28T12:37:54.083 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:37:54.097 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2020-04-28T12:37:54.136 INFO:teuthology.orchestra.run.smithi092.stdout:50 files removed 2020-04-28T12:37:54.164 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:37:54.178 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw 2020-04-28T12:37:54.854 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 183 kB/s | 69 kB 00:00 2020-04-28T12:37:54.942 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 179 kB/s | 69 kB 00:00 2020-04-28T12:37:55.188 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 46 kB/s | 14 kB 00:00 2020-04-28T12:37:55.275 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 46 kB/s | 14 kB 00:00 2020-04-28T12:37:55.521 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-28T12:37:55.602 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:37:55.677 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - AppStream 50 MB/s | 7.0 MB 00:00 2020-04-28T12:37:55.764 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - AppStream 48 MB/s | 7.0 MB 00:00 2020-04-28T12:37:56.850 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:37:56.941 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:37:57.266 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-8 - Extras 89 kB/s | 5.5 kB 00:00 2020-04-28T12:37:57.362 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-8 - Extras 89 kB/s | 5.5 kB 00:00 2020-04-28T12:37:57.408 INFO:teuthology.orchestra.run.smithi138.stdout:Copr repo for ceph-el8 owned by ktdreyer 489 kB/s | 47 kB 00:00 2020-04-28T12:37:57.505 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for ceph-el8 owned by ktdreyer 489 kB/s | 47 kB 00:00 2020-04-28T12:37:57.760 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.4 MB 00:00 2020-04-28T12:37:57.813 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 25 MB/s | 6.4 MB 00:00 2020-04-28T12:37:59.095 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-04-28T12:37:59.125 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-28T12:38:00.085 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:38:00.088 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:00.088 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:38:00.089 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:38:00.090 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:38:00.091 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:38:00.092 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout:Install 21 Packages 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2020-04-28T12:38:00.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:00.094 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 51 M 2020-04-28T12:38:00.094 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:38:00.097 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:38:00.100 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:38:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:38:00.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:38:00.103 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:00.104 INFO:teuthology.orchestra.run.smithi138.stdout:Install 21 Packages 2020-04-28T12:38:00.105 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2020-04-28T12:38:00.105 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:00.105 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 51 M 2020-04-28T12:38:00.105 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:38:02.148 INFO:teuthology.orchestra.run.smithi138.stdout:(1/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 4.8 MB/s | 9.8 MB 00:02 2020-04-28T12:38:02.184 INFO:teuthology.orchestra.run.smithi138.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 672 kB/s | 25 kB 00:00 2020-04-28T12:38:02.231 INFO:teuthology.orchestra.run.smithi138.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 11 MB/s | 508 kB 00:00 2020-04-28T12:38:02.271 INFO:teuthology.orchestra.run.smithi138.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 9.2 MB/s | 377 kB 00:00 2020-04-28T12:38:02.626 INFO:teuthology.orchestra.run.smithi138.stdout:(5/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86_ 18 MB/s | 6.2 MB 00:00 2020-04-28T12:38:02.664 INFO:teuthology.orchestra.run.smithi138.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 1.0 MB/s | 40 kB 00:00 2020-04-28T12:38:02.700 INFO:teuthology.orchestra.run.smithi138.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.7 MB/s | 64 kB 00:00 2020-04-28T12:38:02.738 INFO:teuthology.orchestra.run.smithi138.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 4.2 MB/s | 162 kB 00:00 2020-04-28T12:38:02.779 INFO:teuthology.orchestra.run.smithi138.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 8.6 MB/s | 352 kB 00:00 2020-04-28T12:38:02.818 INFO:teuthology.orchestra.run.smithi138.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 7.7 MB/s | 309 kB 00:00 2020-04-28T12:38:02.856 INFO:teuthology.orchestra.run.smithi138.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 3.0 MB/s | 113 kB 00:00 2020-04-28T12:38:02.891 INFO:teuthology.orchestra.run.smithi138.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 9.7 MB/s | 353 kB 00:00 2020-04-28T12:38:02.896 INFO:teuthology.orchestra.run.smithi138.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 60 MB/s | 259 kB 00:00 2020-04-28T12:38:02.898 INFO:teuthology.orchestra.run.smithi138.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 28 MB/s | 44 kB 00:00 2020-04-28T12:38:02.899 INFO:teuthology.orchestra.run.smithi138.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 27 MB/s | 47 kB 00:00 2020-04-28T12:38:03.015 INFO:teuthology.orchestra.run.smithi138.stdout:(16/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-28T12:38:03.036 INFO:teuthology.orchestra.run.smithi138.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 8.7 MB/s | 181 kB 00:00 2020-04-28T12:38:03.055 INFO:teuthology.orchestra.run.smithi138.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-28T12:38:03.075 INFO:teuthology.orchestra.run.smithi138.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-28T12:38:03.177 INFO:teuthology.orchestra.run.smithi092.stdout:(1/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x8 1.8 MB/s | 5.5 MB 00:03 2020-04-28T12:38:03.215 INFO:teuthology.orchestra.run.smithi092.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 664 kB/s | 25 kB 00:00 2020-04-28T12:38:03.302 INFO:teuthology.orchestra.run.smithi138.stdout:(20/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 16 MB/s | 3.6 MB 00:00 2020-04-28T12:38:03.412 INFO:teuthology.orchestra.run.smithi092.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 2.5 MB/s | 508 kB 00:00 2020-04-28T12:38:03.424 INFO:teuthology.orchestra.run.smithi138.stdout:(21/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 16 MB/s | 1.9 MB 00:00 2020-04-28T12:38:03.557 INFO:teuthology.orchestra.run.smithi092.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 2.6 MB/s | 377 kB 00:00 2020-04-28T12:38:04.269 INFO:teuthology.orchestra.run.smithi138.stdout:(22/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x 1.3 MB/s | 5.5 MB 00:04 2020-04-28T12:38:05.320 INFO:teuthology.orchestra.run.smithi092.stdout:(5/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86_ 3.5 MB/s | 6.2 MB 00:01 2020-04-28T12:38:05.357 INFO:teuthology.orchestra.run.smithi092.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 1.1 MB/s | 40 kB 00:00 2020-04-28T12:38:05.394 INFO:teuthology.orchestra.run.smithi092.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.7 MB/s | 64 kB 00:00 2020-04-28T12:38:05.466 INFO:teuthology.orchestra.run.smithi092.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 2.2 MB/s | 162 kB 00:00 2020-04-28T12:38:05.575 INFO:teuthology.orchestra.run.smithi092.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 3.2 MB/s | 352 kB 00:00 2020-04-28T12:38:05.672 INFO:teuthology.orchestra.run.smithi092.stdout:(10/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el 1.8 MB/s | 9.8 MB 00:05 2020-04-28T12:38:05.710 INFO:teuthology.orchestra.run.smithi092.stdout:(11/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 2.2 MB/s | 309 kB 00:00 2020-04-28T12:38:05.711 INFO:teuthology.orchestra.run.smithi092.stdout:(12/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 2.8 MB/s | 113 kB 00:00 2020-04-28T12:38:05.745 INFO:teuthology.orchestra.run.smithi092.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2020-04-28T12:38:05.746 INFO:teuthology.orchestra.run.smithi092.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 28 MB/s | 44 kB 00:00 2020-04-28T12:38:05.748 INFO:teuthology.orchestra.run.smithi092.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.9 MB/s | 259 kB 00:00 2020-04-28T12:38:05.749 INFO:teuthology.orchestra.run.smithi092.stdout:(16/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 22 MB/s | 47 kB 00:00 2020-04-28T12:38:05.827 INFO:teuthology.orchestra.run.smithi092.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 2.3 MB/s | 181 kB 00:00 2020-04-28T12:38:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-04-28T12:38:05.859 INFO:teuthology.orchestra.run.smithi092.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-04-28T12:38:05.862 INFO:teuthology.orchestra.run.smithi092.stdout:(20/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-28T12:38:06.438 INFO:teuthology.orchestra.run.smithi092.stdout:(21/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 3.3 MB/s | 1.9 MB 00:00 2020-04-28T12:38:06.691 INFO:teuthology.orchestra.run.smithi092.stdout:(22/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 4.3 MB/s | 3.6 MB 00:00 2020-04-28T12:38:08.802 INFO:teuthology.orchestra.run.smithi092.stdout:(23/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 2.4 MB/s | 21 MB 00:08 2020-04-28T12:38:08.806 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:08.806 INFO:teuthology.orchestra.run.smithi092.stdout:Total 5.8 MB/s | 51 MB 00:08 2020-04-28T12:38:08.812 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:38:08.857 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:38:08.857 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:38:09.012 INFO:teuthology.orchestra.run.smithi138.stdout:(23/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 2.3 MB/s | 21 MB 00:08 2020-04-28T12:38:09.016 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:09.016 INFO:teuthology.orchestra.run.smithi138.stdout:Total 5.7 MB/s | 51 MB 00:08 2020-04-28T12:38:09.023 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:38:09.069 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:38:09.070 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:38:09.195 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:38:09.195 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:38:09.431 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:38:09.431 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:38:10.151 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:38:10.367 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:38:10.425 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:38:10.565 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:38:10.619 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:38:10.823 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:38:10.938 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:11.218 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:38:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:11.389 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:38:11.489 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:11.670 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:38:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:11.806 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:38:12.034 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:38:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:38:12.239 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:38:12.297 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:38:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:38:12.447 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:38:12.605 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:38:13.011 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:38:13.164 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:38:13.206 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:38:13.255 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:38:13.339 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:38:13.410 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:38:13.463 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:38:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:38:13.610 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:38:13.723 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:38:13.759 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:38:13.892 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:38:13.968 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:38:14.092 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:38:14.190 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:38:14.267 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:38:14.338 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:38:14.404 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:38:14.413 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:38:14.496 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:38:14.576 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:38:14.676 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:38:14.795 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:38:14.876 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:38:14.966 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:38:15.041 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:38:15.114 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:38:15.231 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:38:18.555 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:18.788 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:18.813 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:19.030 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:19.457 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:19.714 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:38:19.714 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:38:19.797 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:38:19.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:20.005 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:38:20.082 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:38:20.205 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:36.129 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2020-04-28T12:38:36.129 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2020-04-28T12:38:36.129 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2020-04-28T12:38:36.129 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2020-04-28T12:38:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2020-04-28T12:38:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2020-04-28T12:38:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2020-04-28T12:38:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2020-04-28T12:38:36.130 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2020-04-28T12:38:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:36.534 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:36.534 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2020-04-28T12:38:36.534 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2020-04-28T12:38:36.534 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /dev 2020-04-28T12:38:36.534 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /run 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /dev 2020-04-28T12:38:36.535 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:38:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:38:37.295 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:38:37.477 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:38:37.478 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:37.594 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:38:37.659 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:38:37.659 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:38:37.854 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:38:37.854 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:38.112 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:38.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:38:38.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:38:38.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:38.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:38:38.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:38:38.114 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:38:38.115 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:38:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:38:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:38:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:38:38.116 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:38:38.470 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:38.470 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:38:38.471 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:38:38.472 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:38:38.473 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:38:38.473 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:38:38.474 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:38:38.474 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:38:38.474 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:38:38.474 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:38:38.474 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:38:38.475 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:38:38.475 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:38:38.475 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:38:38.903 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:38.903 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:38.903 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.904 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:38:38.906 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:38:38.907 INFO:teuthology.orchestra.run.smithi092.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:38:38.907 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:38:38.907 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:38:38.907 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:38.907 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:38:39.147 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:38:39.147 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:39.147 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.148 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:38:39.150 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:39.151 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:38:39.287 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:38:39.301 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-test 2020-04-28T12:38:39.524 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:38:39.539 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2020-04-28T12:38:39.754 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:40 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:38:39.991 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:40 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:38:40.093 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:38:40.094 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:40.094 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2020-04-28T12:38:40.094 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:40.094 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:38:40.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:40.096 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:38:40.096 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:40.096 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2020-04-28T12:38:40.096 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:40.097 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 43 M 2020-04-28T12:38:40.097 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 185 M 2020-04-28T12:38:40.097 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:38:40.130 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2020-04-28T12:38:40.139 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.3 MB/s | 188 kB 00:00 2020-04-28T12:38:40.140 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 28 MB/s | 298 kB 00:00 2020-04-28T12:38:40.144 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 49 MB/s | 249 kB 00:00 2020-04-28T12:38:40.203 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:38:40.342 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:38:40.343 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:40.343 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2020-04-28T12:38:40.343 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:40.343 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:38:40.344 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:38:40.345 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:40.345 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:38:40.345 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:40.345 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2020-04-28T12:38:40.345 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:40.346 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 43 M 2020-04-28T12:38:40.346 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 185 M 2020-04-28T12:38:40.346 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:38:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2020-04-28T12:38:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 5.0 MB/s | 188 kB 00:00 2020-04-28T12:38:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 30 MB/s | 298 kB 00:00 2020-04-28T12:38:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 48 MB/s | 249 kB 00:00 2020-04-28T12:38:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 916 kB/s | 69 kB 00:00 2020-04-28T12:38:42.446 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 18 MB/s | 42 MB 00:02 2020-04-28T12:38:42.448 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:42.449 INFO:teuthology.orchestra.run.smithi092.stdout:Total 18 MB/s | 43 MB 00:02 2020-04-28T12:38:42.455 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:38:42.475 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:38:42.476 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:38:42.751 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:38:42.751 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:38:43.237 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:38:43.417 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:38:43.605 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:38:43.768 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:38:43.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:38:43.984 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:38:45.532 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 8.1 MB/s | 42 MB 00:05 2020-04-28T12:38:45.535 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:45.535 INFO:teuthology.orchestra.run.smithi138.stdout:Total 8.2 MB/s | 43 MB 00:05 2020-04-28T12:38:45.541 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:38:45.564 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:38:45.564 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:38:45.825 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:38:45.826 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:38:46.984 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:38:47.160 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:38:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:38:47.528 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:38:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:38:47.767 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:38:48.053 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:38:48.276 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:38:48.471 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:38:48.471 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:38:48.471 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:38:48.471 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:38:48.471 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:38:48.472 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:38:48.796 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:38:48.796 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:48.796 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:38:48.796 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:38:48.796 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:38:48.797 INFO:teuthology.orchestra.run.smithi092.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:38:48.797 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:48.797 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:38:49.081 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:38:49.095 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph 2020-04-28T12:38:49.534 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:50 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:38:49.913 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:38:49.917 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:49.917 INFO:teuthology.orchestra.run.smithi092.stdout: Package ArchVersion Repository Size 2020-04-28T12:38:49.917 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:49.917 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:38:49.918 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:38:49.918 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:38:49.918 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:38:49.918 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:38:49.918 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:38:49.919 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:38:49.920 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:38:49.921 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:38:49.922 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:38:49.922 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:38:49.922 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:38:49.922 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:38:49.922 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:49.923 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:38:49.924 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:38:49.924 INFO:teuthology.orchestra.run.smithi092.stdout:Install 32 Packages 2020-04-28T12:38:49.924 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:38:49.925 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 29 M 2020-04-28T12:38:49.925 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 103 M 2020-04-28T12:38:49.925 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:38:50.074 INFO:teuthology.orchestra.run.smithi092.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2020-04-28T12:38:50.383 INFO:teuthology.orchestra.run.smithi092.stdout:(2/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 4.4 MB/s | 2.0 MB 00:00 2020-04-28T12:38:50.387 INFO:teuthology.orchestra.run.smithi092.stdout:(3/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 3.0 MB/s | 1.4 MB 00:00 2020-04-28T12:38:50.472 INFO:teuthology.orchestra.run.smithi092.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 1.9 MB/s | 164 kB 00:00 2020-04-28T12:38:50.504 INFO:teuthology.orchestra.run.smithi092.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.5 MB/s | 214 kB 00:00 2020-04-28T12:38:50.523 INFO:teuthology.orchestra.run.smithi092.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2020-04-28T12:38:50.526 INFO:teuthology.orchestra.run.smithi092.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 45 MB/s | 157 kB 00:00 2020-04-28T12:38:50.528 INFO:teuthology.orchestra.run.smithi092.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 21 MB/s | 39 kB 00:00 2020-04-28T12:38:50.530 INFO:teuthology.orchestra.run.smithi092.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 39 MB/s | 54 kB 00:00 2020-04-28T12:38:50.532 INFO:teuthology.orchestra.run.smithi092.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 14 MB/s | 27 kB 00:00 2020-04-28T12:38:50.542 INFO:teuthology.orchestra.run.smithi092.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 45 MB/s | 457 kB 00:00 2020-04-28T12:38:50.587 INFO:teuthology.orchestra.run.smithi092.stdout:(12/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 8.5 MB/s | 4.4 MB 00:00 2020-04-28T12:38:50.615 INFO:teuthology.orchestra.run.smithi092.stdout:(13/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.0 MB/s | 145 kB 00:00 2020-04-28T12:38:50.620 INFO:teuthology.orchestra.run.smithi092.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:38:50.633 INFO:teuthology.orchestra.run.smithi092.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 1.6 MB/s | 18 kB 00:00 2020-04-28T12:38:50.642 INFO:teuthology.orchestra.run.smithi092.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 4.6 MB/s | 49 kB 00:00 2020-04-28T12:38:50.654 INFO:teuthology.orchestra.run.smithi092.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 5.1 MB/s | 59 kB 00:00 2020-04-28T12:38:50.656 INFO:teuthology.orchestra.run.smithi092.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 5.4 MB/s | 385 kB 00:00 2020-04-28T12:38:50.665 INFO:teuthology.orchestra.run.smithi092.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.8 MB/s | 16 kB 00:00 2020-04-28T12:38:50.671 INFO:teuthology.orchestra.run.smithi092.stdout:(20/32): python3-pecan-1.3.2-9.el8.noarch.rpm 16 MB/s | 283 kB 00:00 2020-04-28T12:38:50.673 INFO:teuthology.orchestra.run.smithi092.stdout:(21/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:38:50.680 INFO:teuthology.orchestra.run.smithi092.stdout:(22/32): python3-singledispatch-3.4.0.3-18.el8. 2.8 MB/s | 24 kB 00:00 2020-04-28T12:38:50.685 INFO:teuthology.orchestra.run.smithi092.stdout:(23/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.0 MB/s | 30 kB 00:00 2020-04-28T12:38:50.688 INFO:teuthology.orchestra.run.smithi092.stdout:(24/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.2 MB/s | 27 kB 00:00 2020-04-28T12:38:50.691 INFO:teuthology.orchestra.run.smithi092.stdout:(25/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.8 MB/s | 23 kB 00:00 2020-04-28T12:38:50.763 INFO:teuthology.orchestra.run.smithi092.stdout:(26/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 579 kB/s | 44 kB 00:00 2020-04-28T12:38:50.783 INFO:teuthology.orchestra.run.smithi092.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.1 MB/s | 40 kB 00:00 2020-04-28T12:38:50.785 INFO:teuthology.orchestra.run.smithi092.stdout:(28/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.9 MB/s | 185 kB 00:00 2020-04-28T12:38:50.821 INFO:teuthology.orchestra.run.smithi092.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 6.1 MB/s | 241 kB 00:00 2020-04-28T12:38:50.823 INFO:teuthology.orchestra.run.smithi092.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 6.4 MB/s | 251 kB 00:00 2020-04-28T12:38:50.841 INFO:teuthology.orchestra.run.smithi092.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 4.3 MB/s | 85 kB 00:00 2020-04-28T12:38:51.222 INFO:teuthology.orchestra.run.smithi092.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 20 MB/s | 17 MB 00:00 2020-04-28T12:38:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:51.233 INFO:teuthology.orchestra.run.smithi092.stdout:Total 22 MB/s | 29 MB 00:01 2020-04-28T12:38:51.244 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:38:51.281 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:38:51.281 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:38:51.785 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:38:51.971 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:38:51.972 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:38:51.997 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:38:52.456 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:38:52.456 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:38:52.457 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:38:52.457 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:38:52.457 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:38:52.457 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:38:53.385 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:38:53.591 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:38:53.755 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:38:53.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:53.756 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:38:53.756 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:38:53.756 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:38:53.756 INFO:teuthology.orchestra.run.smithi138.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:38:53.757 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:53.757 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:38:53.775 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:38:53.972 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:38:53.988 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2020-04-28T12:38:53.989 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:38:54.122 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:38:54.296 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:38:54.427 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:55 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:38:54.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:38:54.603 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:38:54.742 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:38:54.794 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:38:54.797 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout: Package ArchVersion Repository Size 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:38:54.798 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:38:54.799 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:38:54.800 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:38:54.801 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:38:54.802 INFO:teuthology.orchestra.run.smithi138.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:38:54.802 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:38:54.802 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:38:54.803 INFO:teuthology.orchestra.run.smithi138.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:38:54.803 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:38:54.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:38:54.804 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:38:54.804 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2020-04-28T12:38:54.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:38:54.805 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:38:54.805 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:54.806 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:38:54.806 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:38:54.806 INFO:teuthology.orchestra.run.smithi138.stdout:Install 32 Packages 2020-04-28T12:38:54.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:38:54.807 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 29 M 2020-04-28T12:38:54.808 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 103 M 2020-04-28T12:38:54.808 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:38:54.872 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:38:54.954 INFO:teuthology.orchestra.run.smithi138.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2020-04-28T12:38:55.024 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:38:55.185 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:38:55.268 INFO:teuthology.orchestra.run.smithi138.stdout:(2/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 4.4 MB/s | 2.0 MB 00:00 2020-04-28T12:38:55.273 INFO:teuthology.orchestra.run.smithi138.stdout:(3/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 3.0 MB/s | 1.4 MB 00:00 2020-04-28T12:38:55.356 INFO:teuthology.orchestra.run.smithi138.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 1.9 MB/s | 164 kB 00:00 2020-04-28T12:38:55.382 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:38:55.390 INFO:teuthology.orchestra.run.smithi138.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2020-04-28T12:38:55.408 INFO:teuthology.orchestra.run.smithi138.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 78 MB/s | 1.5 MB 00:00 2020-04-28T12:38:55.411 INFO:teuthology.orchestra.run.smithi138.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 60 MB/s | 157 kB 00:00 2020-04-28T12:38:55.412 INFO:teuthology.orchestra.run.smithi138.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 30 MB/s | 39 kB 00:00 2020-04-28T12:38:55.414 INFO:teuthology.orchestra.run.smithi138.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 39 MB/s | 54 kB 00:00 2020-04-28T12:38:55.415 INFO:teuthology.orchestra.run.smithi138.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 20 MB/s | 27 kB 00:00 2020-04-28T12:38:55.422 INFO:teuthology.orchestra.run.smithi138.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 75 MB/s | 457 kB 00:00 2020-04-28T12:38:55.470 INFO:teuthology.orchestra.run.smithi138.stdout:(12/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 8.5 MB/s | 4.4 MB 00:00 2020-04-28T12:38:55.483 INFO:teuthology.orchestra.run.smithi138.stdout:(13/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.3 MB/s | 145 kB 00:00 2020-04-28T12:38:55.493 INFO:teuthology.orchestra.run.smithi138.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.1 MB/s | 11 kB 00:00 2020-04-28T12:38:55.502 INFO:teuthology.orchestra.run.smithi138.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.0 MB/s | 18 kB 00:00 2020-04-28T12:38:55.512 INFO:teuthology.orchestra.run.smithi138.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.2 MB/s | 49 kB 00:00 2020-04-28T12:38:55.522 INFO:teuthology.orchestra.run.smithi138.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 5.9 MB/s | 59 kB 00:00 2020-04-28T12:38:55.539 INFO:teuthology.orchestra.run.smithi138.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 5.4 MB/s | 385 kB 00:00 2020-04-28T12:38:55.541 INFO:teuthology.orchestra.run.smithi138.stdout:(19/32): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-04-28T12:38:55.548 INFO:teuthology.orchestra.run.smithi138.stdout:(20/32): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-28T12:38:55.549 INFO:teuthology.orchestra.run.smithi138.stdout:(21/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:38:55.556 INFO:teuthology.orchestra.run.smithi138.stdout:(22/32): python3-singledispatch-3.4.0.3-18.el8. 2.9 MB/s | 24 kB 00:00 2020-04-28T12:38:55.557 INFO:teuthology.orchestra.run.smithi138.stdout:(23/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.5 MB/s | 30 kB 00:00 2020-04-28T12:38:55.564 INFO:teuthology.orchestra.run.smithi138.stdout:(24/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.2 MB/s | 27 kB 00:00 2020-04-28T12:38:55.565 INFO:teuthology.orchestra.run.smithi138.stdout:(25/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.8 MB/s | 23 kB 00:00 2020-04-28T12:38:55.626 INFO:teuthology.orchestra.run.smithi138.stdout:(26/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 707 kB/s | 44 kB 00:00 2020-04-28T12:38:55.634 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:38:55.642 INFO:teuthology.orchestra.run.smithi138.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.5 MB/s | 40 kB 00:00 2020-04-28T12:38:55.643 INFO:teuthology.orchestra.run.smithi138.stdout:(28/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.3 MB/s | 185 kB 00:00 2020-04-28T12:38:55.675 INFO:teuthology.orchestra.run.smithi138.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.3 MB/s | 241 kB 00:00 2020-04-28T12:38:55.676 INFO:teuthology.orchestra.run.smithi138.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 7.6 MB/s | 251 kB 00:00 2020-04-28T12:38:55.691 INFO:teuthology.orchestra.run.smithi138.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 5.2 MB/s | 85 kB 00:00 2020-04-28T12:38:55.823 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:38:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:38:56.038 INFO:teuthology.orchestra.run.smithi138.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 22 MB/s | 17 MB 00:00 2020-04-28T12:38:56.042 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:38:56.042 INFO:teuthology.orchestra.run.smithi138.stdout:Total 23 MB/s | 29 MB 00:01 2020-04-28T12:38:56.059 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:38:56.095 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:38:56.096 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:38:56.216 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:38:56.421 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:38:56.421 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:38:56.563 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:38:56.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:38:57.035 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:38:57.198 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:38:57.359 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:38:57.573 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:38:57.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:38:57.776 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:38:57.791 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:38:57.961 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:38:57.998 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:38:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:38:58.282 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:38:58.306 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:38:58.498 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:38:58.577 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:38:58.648 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:38:58.830 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:38:58.879 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:38:58.969 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:38:59.038 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:38:59.100 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:38:59.293 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:38:59.421 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:38:59.602 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:38:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:39:00.025 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:39:00.250 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:39:00.460 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:39:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:39:00.620 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:39:00.827 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:39:01.005 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:39:01.114 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:39:01.137 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:39:01.312 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:39:01.330 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:39:01.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:39:01.505 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:39:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:39:01.621 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:39:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:39:01.904 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:39:01.936 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:39:01.936 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:39:01.936 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:39:01.936 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:39:01.937 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:39:01.938 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:39:01.939 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:39:01.939 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:39:01.939 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:39:01.941 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:39:01.941 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:39:01.942 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:39:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:39:02.093 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:39:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:39:02.637 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:02.638 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:39:02.639 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:39:02.640 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:39:02.641 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:39:02.642 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:39:02.642 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:39:02.642 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:39:02.642 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:39:02.642 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:39:02.645 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:39:02.645 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:02.645 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:02.646 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:39:02.902 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:02.916 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-base 2020-04-28T12:39:02.954 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:39:03.264 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:39:03.359 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:04 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:03.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:39:03.593 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:03.698 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:03.699 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:03.699 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:03.842 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:03.855 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install cephadm 2020-04-28T12:39:04.292 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:05 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:04.628 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:04.629 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:04.629 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2020-04-28T12:39:04.629 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:04.629 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:04.629 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 41 k 2020-04-28T12:39:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 161 k 2020-04-28T12:39:04.631 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:04.821 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:39:04.853 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 183 kB/s | 41 kB 00:00 2020-04-28T12:39:04.854 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:04.854 INFO:teuthology.orchestra.run.smithi092.stdout:Total 182 kB/s | 41 kB 00:00 2020-04-28T12:39:04.856 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:04.864 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:04.864 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:04.866 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:04.866 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:04.939 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:05.006 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:39:05.391 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:39:05.531 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:39:05.726 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:39:05.881 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:39:05.899 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:39:06.025 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:39:06.208 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:06.318 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:39:06.318 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:39:06.319 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:39:06.320 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:39:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:39:06.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:39:06.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:39:06.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:39:06.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:39:06.322 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:39:06.328 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:39:06.329 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:39:06.329 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:39:06.329 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:39:06.468 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:06.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:06.693 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:06.693 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:06.829 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:06.844 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:39:06.934 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:39:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:06.982 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:06.982 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:06.983 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:39:06.984 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:39:06.985 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:39:06.986 INFO:teuthology.orchestra.run.smithi138.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:39:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:39:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:39:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:39:06.987 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:06.987 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:07.238 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:07.253 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2020-04-28T12:39:07.291 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:08 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:07.698 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:08 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:07.942 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:08.039 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:08.039 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:08.040 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:08.041 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:08.041 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:08.041 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:08.041 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 203 k 2020-04-28T12:39:08.042 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 743 k 2020-04-28T12:39:08.042 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:08.047 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:08.047 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:08.162 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:08.175 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2020-04-28T12:39:08.337 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 686 kB/s | 203 kB 00:00 2020-04-28T12:39:08.337 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:08.338 INFO:teuthology.orchestra.run.smithi092.stdout:Total 684 kB/s | 203 kB 00:00 2020-04-28T12:39:08.340 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:08.352 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:08.352 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:08.399 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:08.399 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:08.556 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:08.614 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:09 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:08.995 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:08.996 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:08.997 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2020-04-28T12:39:08.997 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:08.997 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:08.997 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:39:08.998 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:08.998 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:08.998 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:08.998 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:08.999 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:09.007 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:09.009 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 41 k 2020-04-28T12:39:09.009 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 161 k 2020-04-28T12:39:09.009 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:09.249 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 170 kB/s | 41 kB 00:00 2020-04-28T12:39:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:Total 169 kB/s | 41 kB 00:00 2020-04-28T12:39:09.252 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:09.260 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:09.260 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:09.262 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:09.262 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:09.267 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:09.526 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:09.540 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr 2020-04-28T12:39:09.671 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:09.988 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:10 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:10.225 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:10.328 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:10.329 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:10.329 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:10.455 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:10.468 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:39:10.904 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:11 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:11.075 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:39:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:39:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2020-04-28T12:39:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 3.6 M 2020-04-28T12:39:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 19 M 2020-04-28T12:39:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:11.343 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:11.401 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 54 kB/s | 8.8 kB 00:00 2020-04-28T12:39:11.428 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 119 kB/s | 22 kB 00:00 2020-04-28T12:39:11.432 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-04-28T12:39:11.486 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 598 kB/s | 34 kB 00:00 2020-04-28T12:39:11.503 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.7 MB/s | 197 kB 00:00 2020-04-28T12:39:11.556 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:11.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:11.556 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:11.556 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:11.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:11.557 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:11.703 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 7.2 MB/s | 3.3 MB 00:00 2020-04-28T12:39:11.705 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:11.706 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:11.706 INFO:teuthology.orchestra.run.smithi092.stdout:Total 7.8 MB/s | 3.6 MB 00:00 2020-04-28T12:39:11.711 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:11.719 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:39:11.719 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:11.720 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:11.856 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:11.857 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:12.163 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:13 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:12.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:39:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:12.529 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:12.531 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 203 k 2020-04-28T12:39:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 743 k 2020-04-28T12:39:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:39:12.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:39:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 689 kB/s | 203 kB 00:00 2020-04-28T12:39:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:Total 686 kB/s | 203 kB 00:00 2020-04-28T12:39:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:12.832 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:39:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:12.887 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:12.887 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:13.146 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:13.489 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:13.769 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:39:13.769 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:13.769 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:13.769 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:13.769 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:13.770 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:13.844 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:39:14.067 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:14.085 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2020-04-28T12:39:14.126 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:39:14.370 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:39:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:39:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:39:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:39:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:39:14.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:39:14.528 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:15 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:14.627 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:39:14.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:39:14.629 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:39:14.629 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:14.629 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:14.749 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:14.762 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:39:14.783 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:14.886 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:14.887 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:14.887 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:15.039 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:15.052 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:39:15.199 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:16 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:15.489 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:16 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:15.545 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:15.546 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:39:15.547 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:39:15.548 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:15.549 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:15.549 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:15.549 INFO:teuthology.orchestra.run.smithi092.stdout:Install 8 Packages 2020-04-28T12:39:15.549 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:15.550 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 37 M 2020-04-28T12:39:15.550 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 205 M 2020-04-28T12:39:15.550 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:15.653 INFO:teuthology.orchestra.run.smithi092.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 41 MB/s | 4.3 MB 00:00 2020-04-28T12:39:15.709 INFO:teuthology.orchestra.run.smithi092.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2020-04-28T12:39:15.726 INFO:teuthology.orchestra.run.smithi092.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 52 MB/s | 3.7 MB 00:00 2020-04-28T12:39:15.727 INFO:teuthology.orchestra.run.smithi092.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 13 MB/s | 225 kB 00:00 2020-04-28T12:39:15.748 INFO:teuthology.orchestra.run.smithi092.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 30 MB/s | 638 kB 00:00 2020-04-28T12:39:15.757 INFO:teuthology.orchestra.run.smithi092.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 18 MB/s | 169 kB 00:00 2020-04-28T12:39:15.837 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:15.838 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:15.838 INFO:teuthology.orchestra.run.smithi138.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:15.838 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:39:15.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2020-04-28T12:39:15.840 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:15.841 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.6 M 2020-04-28T12:39:15.841 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 19 M 2020-04-28T12:39:15.841 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:15.968 INFO:teuthology.orchestra.run.smithi092.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 60 MB/s | 15 MB 00:00 2020-04-28T12:39:16.003 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 54 kB/s | 8.8 kB 00:00 2020-04-28T12:39:16.055 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 109 kB/s | 22 kB 00:00 2020-04-28T12:39:16.070 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 630 kB/s | 43 kB 00:00 2020-04-28T12:39:16.096 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 687 kB/s | 34 kB 00:00 2020-04-28T12:39:16.133 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.1 MB/s | 197 kB 00:00 2020-04-28T12:39:16.263 INFO:teuthology.orchestra.run.smithi092.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 12 MB/s | 8.6 MB 00:00 2020-04-28T12:39:16.265 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:16.265 INFO:teuthology.orchestra.run.smithi092.stdout:Total 51 MB/s | 37 MB 00:00 2020-04-28T12:39:16.276 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:16.294 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:16.294 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:16.600 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:16.601 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:17.179 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 2.5 MB/s | 3.3 MB 00:01 2020-04-28T12:39:17.182 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:17.183 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.7 MB/s | 3.6 MB 00:01 2020-04-28T12:39:17.188 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:17.197 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:17.197 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:17.249 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:39:17.341 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:17.341 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:17.384 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:39:17.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:39:17.582 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:17.743 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:39:17.963 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:39:18.083 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:39:18.181 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:39:18.293 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:39:19.310 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:39:19.612 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:39:19.691 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:39:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:39:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:39:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:39:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:39:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:39:20.332 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:20.482 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:39:21.170 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:39:21.321 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:39:21.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:39:21.322 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:39:21.323 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:39:21.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:21.323 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:21.444 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:21.457 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:39:21.477 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:39:21.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:39:21.896 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:22 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:22.244 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:22.246 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:22.246 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:22.246 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:39:22.247 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:39:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:39:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:39:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:39:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:39:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:39:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:39:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:39:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:22.250 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:22.250 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:22.250 INFO:teuthology.orchestra.run.smithi138.stdout:Install 8 Packages 2020-04-28T12:39:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:22.251 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 37 M 2020-04-28T12:39:22.251 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 205 M 2020-04-28T12:39:22.251 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:22.363 INFO:teuthology.orchestra.run.smithi138.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 38 MB/s | 4.3 MB 00:00 2020-04-28T12:39:22.422 INFO:teuthology.orchestra.run.smithi138.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 64 MB/s | 3.7 MB 00:00 2020-04-28T12:39:22.428 INFO:teuthology.orchestra.run.smithi138.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 38 MB/s | 225 kB 00:00 2020-04-28T12:39:22.456 INFO:teuthology.orchestra.run.smithi138.stdout:(4/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2020-04-28T12:39:22.477 INFO:teuthology.orchestra.run.smithi138.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 30 MB/s | 638 kB 00:00 2020-04-28T12:39:22.487 INFO:teuthology.orchestra.run.smithi138.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 16 MB/s | 169 kB 00:00 2020-04-28T12:39:22.683 INFO:teuthology.orchestra.run.smithi138.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 57 MB/s | 15 MB 00:00 2020-04-28T12:39:22.984 INFO:teuthology.orchestra.run.smithi138.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 12 MB/s | 8.6 MB 00:00 2020-04-28T12:39:22.986 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:22.987 INFO:teuthology.orchestra.run.smithi138.stdout:Total 49 MB/s | 37 MB 00:00 2020-04-28T12:39:22.997 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:23.015 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:23.015 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:23.330 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:23.330 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:23.654 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:39:23.878 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:39:24.152 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:39:24.353 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:39:24.894 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:39:24.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:39:25.027 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:25.123 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:39:25.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:39:25.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:39:25.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:39:25.566 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:25.661 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:39:25.661 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:25.661 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:39:25.662 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:39:25.663 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:39:25.663 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:25.663 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:25.678 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:39:25.789 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:25.802 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:39:26.241 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:27 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:26.368 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:39:26.626 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:26.628 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:26.628 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2020-04-28T12:39:26.629 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:26.629 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:26.629 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:39:26.629 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-noarch 27 k 2020-04-28T12:39:26.630 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:39:26.630 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:39:26.630 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:39:26.630 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:39:26.631 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:39:26.631 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:39:26.631 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:39:26.631 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:39:26.632 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:39:26.632 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:39:26.632 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:39:26.632 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:39:26.633 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:39:26.633 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:26.633 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:26.633 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:26.633 INFO:teuthology.orchestra.run.smithi092.stdout:Install 13 Packages 2020-04-28T12:39:26.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:26.635 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 1.9 M 2020-04-28T12:39:26.635 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 23 M 2020-04-28T12:39:26.636 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:26.662 INFO:teuthology.orchestra.run.smithi092.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 892 kB/s | 27 kB 00:00 2020-04-28T12:39:26.670 INFO:teuthology.orchestra.run.smithi092.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 45 MB/s | 126 kB 00:00 2020-04-28T12:39:26.670 INFO:teuthology.orchestra.run.smithi092.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 577 kB/s | 20 kB 00:00 2020-04-28T12:39:26.670 INFO:teuthology.orchestra.run.smithi092.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 46 MB/s | 110 kB 00:00 2020-04-28T12:39:26.675 INFO:teuthology.orchestra.run.smithi092.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 7.3 MB/s | 43 kB 00:00 2020-04-28T12:39:26.675 INFO:teuthology.orchestra.run.smithi092.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 19 MB/s | 155 kB 00:00 2020-04-28T12:39:26.730 INFO:teuthology.orchestra.run.smithi092.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 579 kB/s | 33 kB 00:00 2020-04-28T12:39:26.731 INFO:teuthology.orchestra.run.smithi092.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 291 kB/s | 16 kB 00:00 2020-04-28T12:39:26.768 INFO:teuthology.orchestra.run.smithi092.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.1 MB/s | 81 kB 00:00 2020-04-28T12:39:26.787 INFO:teuthology.orchestra.run.smithi092.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-28T12:39:26.806 INFO:teuthology.orchestra.run.smithi092.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.1 MB/s | 61 kB 00:00 2020-04-28T12:39:26.818 INFO:teuthology.orchestra.run.smithi092.stdout:(12/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 145 kB/s | 27 kB 00:00 2020-04-28T12:39:26.846 INFO:teuthology.orchestra.run.smithi092.stdout:(13/13): python3-kubernetes-10.0.1-2.el8.noarch 9.7 MB/s | 1.1 MB 00:00 2020-04-28T12:39:26.846 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:26.847 INFO:teuthology.orchestra.run.smithi092.stdout:Total 8.6 MB/s | 1.9 MB 00:00 2020-04-28T12:39:26.854 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:26.868 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:26.868 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:26.894 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:39:26.943 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:26.943 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:27.111 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:39:27.418 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:27.725 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:39:27.935 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:39:28.124 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:39:28.345 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:39:28.519 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:39:28.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:39:29.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:39:29.083 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:39:29.226 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:39:30.262 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:39:30.349 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:39:30.552 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:39:30.797 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:39:30.797 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:39:30.797 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:39:30.797 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:39:30.798 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:39:30.798 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:39:30.798 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:39:30.798 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:39:31.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:39:31.087 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:31.088 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:31.220 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:31.233 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:39:31.413 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:39:31.571 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:39:31.671 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:32 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:31.796 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:39:31.979 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:32.019 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-noarch 27 k 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:39:32.020 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:39:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:39:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:32.022 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:32.022 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:32.022 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2020-04-28T12:39:32.022 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:32.023 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 1.9 M 2020-04-28T12:39:32.023 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 23 M 2020-04-28T12:39:32.023 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:32.055 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 880 kB/s | 27 kB 00:00 2020-04-28T12:39:32.055 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 40 MB/s | 126 kB 00:00 2020-04-28T12:39:32.056 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 586 kB/s | 20 kB 00:00 2020-04-28T12:39:32.058 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 40 MB/s | 110 kB 00:00 2020-04-28T12:39:32.064 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 7.9 MB/s | 43 kB 00:00 2020-04-28T12:39:32.064 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 18 MB/s | 155 kB 00:00 2020-04-28T12:39:32.111 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 351 kB/s | 16 kB 00:00 2020-04-28T12:39:32.121 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 577 kB/s | 33 kB 00:00 2020-04-28T12:39:32.157 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.7 MB/s | 81 kB 00:00 2020-04-28T12:39:32.173 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-04-28T12:39:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.8 MB/s | 61 kB 00:00 2020-04-28T12:39:32.194 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:39:32.194 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:39:32.195 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:39:32.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:39:32.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:39:32.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:39:32.196 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:39:32.210 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 145 kB/s | 27 kB 00:00 2020-04-28T12:39:32.218 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-kubernetes-10.0.1-2.el8.noarch 11 MB/s | 1.1 MB 00:00 2020-04-28T12:39:32.220 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:32.220 INFO:teuthology.orchestra.run.smithi138.stdout:Total 9.3 MB/s | 1.9 MB 00:00 2020-04-28T12:39:32.227 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:32.241 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:32.241 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:32.312 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:32.312 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:32.528 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:39:32.529 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:39:32.530 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:39:32.531 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:39:32.531 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:39:32.531 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:32.531 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:32.656 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:32.669 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:39:32.793 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:33.079 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:39:33.109 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:34 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:39:33.457 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:33.457 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:39:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:39:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:39:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:33.461 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:33.461 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:33.461 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2020-04-28T12:39:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:33.462 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 467 k 2020-04-28T12:39:33.462 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 1.4 M 2020-04-28T12:39:33.463 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:33.516 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 852 kB/s | 48 kB 00:00 2020-04-28T12:39:33.520 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:39:33.529 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.0 MB/s | 356 kB 00:00 2020-04-28T12:39:33.578 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 376 kB/s | 21 kB 00:00 2020-04-28T12:39:33.683 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 186 kB/s | 42 kB 00:00 2020-04-28T12:39:33.684 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:33.685 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:39:33.689 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:33.695 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:33.696 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:33.717 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:33.718 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:33.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:39:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:33.924 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:39:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:39:34.114 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:39:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:39:34.374 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:39:34.478 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:39:34.581 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:39:34.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:39:34.839 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:39:34.839 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:39:34.840 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:39:34.840 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:39:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:39:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:35.059 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:39:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:39:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:39:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:35.060 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:35.175 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:35.188 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-fuse 2020-04-28T12:39:35.630 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:39:35.635 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:36 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:35.883 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:39:35.981 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:39:35.982 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout:Install 3 Packages 2020-04-28T12:39:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:35.984 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 676 k 2020-04-28T12:39:35.984 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 2.1 M 2020-04-28T12:39:35.984 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:36.014 INFO:teuthology.orchestra.run.smithi092.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 82 kB 00:00 2020-04-28T12:39:36.017 INFO:teuthology.orchestra.run.smithi092.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 634 kB/s | 21 kB 00:00 2020-04-28T12:39:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:39:36.217 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:39:36.317 INFO:teuthology.orchestra.run.smithi092.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.7 MB/s | 572 kB 00:00 2020-04-28T12:39:36.318 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:36.319 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.0 MB/s | 676 kB 00:00 2020-04-28T12:39:36.322 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:36.342 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:36.343 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:36.367 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:39:36.406 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:36.406 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:36.587 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:39:36.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:39:36.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:39:36.837 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:36.837 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:39:36.838 INFO:teuthology.orchestra.run.smithi092.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:39:36.838 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:36.919 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:39:36.919 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:36.919 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:39:36.920 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:39:36.921 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:39:36.921 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:39:36.921 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:36.922 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:37.032 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:37.046 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:39:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:39:37.394 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:39:37.488 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:38 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:37.678 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:39:37.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:39:37.678 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:39:37.927 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:37.928 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:38.068 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout: Package ArchVersion Repository Size 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:39:38.069 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:38.070 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2020-04-28T12:39:38.071 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:38.071 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 467 k 2020-04-28T12:39:38.071 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 1.4 M 2020-04-28T12:39:38.072 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:38.128 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 846 kB/s | 48 kB 00:00 2020-04-28T12:39:38.139 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.1 MB/s | 356 kB 00:00 2020-04-28T12:39:38.184 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 376 kB/s | 21 kB 00:00 2020-04-28T12:39:38.232 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:38.246 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install librados-devel 2020-04-28T12:39:38.295 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 186 kB/s | 42 kB 00:00 2020-04-28T12:39:38.296 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:38.297 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:39:38.300 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:38.309 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:38.312 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:38.330 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:38.331 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:38.502 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:38.699 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:39 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:38.725 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:39:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:39:39.046 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:39.047 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:39.047 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2020-04-28T12:39:39.047 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:39.048 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 141 k 2020-04-28T12:39:39.049 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 487 k 2020-04-28T12:39:39.049 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:39.149 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:39:39.308 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:39:39.317 INFO:teuthology.orchestra.run.smithi092.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 523 kB/s | 141 kB 00:00 2020-04-28T12:39:39.318 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:39.318 INFO:teuthology.orchestra.run.smithi092.stdout:Total 520 kB/s | 141 kB 00:00 2020-04-28T12:39:39.320 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:39.328 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:39.328 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:39.376 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:39.377 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:39.494 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:39:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:39:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:39:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:39:39.676 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:39.752 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:39:39.753 INFO:teuthology.orchestra.run.smithi138.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:39:39.754 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:39.754 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:39.864 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:39.877 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2020-04-28T12:39:39.879 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:40.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:40.129 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:40.129 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:40.129 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:40.129 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:40.129 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:40.318 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:40.389 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:40.403 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs2 2020-04-28T12:39:40.698 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:40.698 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2020-04-28T12:39:40.699 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:40.699 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:40.699 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:40.700 INFO:teuthology.orchestra.run.smithi138.stdout:Install 3 Packages 2020-04-28T12:39:40.701 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:40.701 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 676 k 2020-04-28T12:39:40.701 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 2.1 M 2020-04-28T12:39:40.701 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:40.731 INFO:teuthology.orchestra.run.smithi138.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2020-04-28T12:39:40.734 INFO:teuthology.orchestra.run.smithi138.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 624 kB/s | 21 kB 00:00 2020-04-28T12:39:40.849 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:41.093 INFO:teuthology.orchestra.run.smithi092.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:41.138 INFO:teuthology.orchestra.run.smithi138.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.3 MB/s | 572 kB 00:00 2020-04-28T12:39:41.140 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:41.140 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.5 MB/s | 676 kB 00:00 2020-04-28T12:39:41.144 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:41.165 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:41.165 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:41.199 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:41.200 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:41.200 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:41.235 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:41.236 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:41.317 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:41.330 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs-devel 2020-04-28T12:39:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:39:41.392 INFO:teuthology.orchestra.run.smithi138.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:39:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:41.769 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:42 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:41.789 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:39:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:39:42.129 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:39:42.130 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:42.131 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:42.131 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:42.131 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:42.131 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:42.141 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 21 k 2020-04-28T12:39:42.142 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 76 k 2020-04-28T12:39:42.142 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:39:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:39:42.263 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:39:42.330 INFO:teuthology.orchestra.run.smithi092.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 114 kB/s | 21 kB 00:00 2020-04-28T12:39:42.331 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:42.331 INFO:teuthology.orchestra.run.smithi092.stdout:Total 113 kB/s | 21 kB 00:00 2020-04-28T12:39:42.332 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:42.336 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:42.337 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:42.339 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:42.339 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:42.487 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:42.518 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:42.519 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:42.625 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:42.837 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:42.995 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:43.010 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:43.055 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:43.184 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:43.197 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install librados2 2020-04-28T12:39:43.522 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:43.638 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:43.901 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:43.907 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:43.908 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:43.910 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2020-04-28T12:39:43.910 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:43.910 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:43.910 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:39:43.911 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:43.911 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:43.911 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:43.911 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:43.911 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:43.912 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 141 k 2020-04-28T12:39:43.912 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 487 k 2020-04-28T12:39:43.912 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:44.003 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:44.004 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:44.004 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:44.131 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:44.146 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install librbd1 2020-04-28T12:39:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 542 kB/s | 141 kB 00:00 2020-04-28T12:39:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:Total 538 kB/s | 141 kB 00:00 2020-04-28T12:39:44.172 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:44.179 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:44.179 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:44.228 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:44.228 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:44.375 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:44.564 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:44.587 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:45 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:44.770 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:44.826 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:44.928 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:44.929 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:44.929 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:45.034 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:45.034 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:45.034 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:45.034 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:45.035 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:45.035 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:45.075 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:45.088 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rados 2020-04-28T12:39:45.300 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:45.314 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2020-04-28T12:39:45.527 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:45.760 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:45.775 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:45.878 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:45.879 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:45.879 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:46.024 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:46.037 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rgw 2020-04-28T12:39:46.041 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:46.146 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:46.147 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:46.148 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:46.289 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:46.303 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2020-04-28T12:39:46.475 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:46.742 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:46.745 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:46.844 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:46.846 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:46.846 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:46.981 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:47.000 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-cephfs 2020-04-28T12:39:47.097 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:39:47.098 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 21 k 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 76 k 2020-04-28T12:39:47.099 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:47.286 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 114 kB/s | 21 kB 00:00 2020-04-28T12:39:47.286 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:47.287 INFO:teuthology.orchestra.run.smithi138.stdout:Total 113 kB/s | 21 kB 00:00 2020-04-28T12:39:47.289 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:47.292 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:47.292 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:47.294 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:47.295 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:47.442 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:48 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:47.480 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:47.683 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:47.787 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:47.788 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:47.788 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:47.902 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:47.902 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:47.902 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:47.902 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:47.903 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:47.903 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:47.933 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:47.946 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rbd 2020-04-28T12:39:48.057 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:48.071 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2020-04-28T12:39:48.386 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:48.513 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:48.641 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:48.744 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:48.745 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2020-04-28T12:39:48.745 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:48.777 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:48.880 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:48.881 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:48.881 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:48.899 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:48.912 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-fuse 2020-04-28T12:39:49.155 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:49.169 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2020-04-28T12:39:49.354 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:50 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:49.611 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:50 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:49.728 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:49.729 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:49.729 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2020-04-28T12:39:49.729 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:49.729 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:49.729 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:39:49.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:49.730 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:49.730 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:49.730 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:49.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:49.731 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 72 k 2020-04-28T12:39:49.731 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 230 k 2020-04-28T12:39:49.731 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:49.861 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:49.954 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 323 kB/s | 72 kB 00:00 2020-04-28T12:39:49.955 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:49.955 INFO:teuthology.orchestra.run.smithi092.stdout:Total 321 kB/s | 72 kB 00:00 2020-04-28T12:39:49.957 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:49.962 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:49.964 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:49.964 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:49.968 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:49.968 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:50.016 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:50.017 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:50.089 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:50.102 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2020-04-28T12:39:50.127 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:50.290 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:50.493 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:50.551 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:51 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:50.788 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:50.788 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:50.788 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:50.788 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:50.788 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:50.789 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:50.810 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:50.914 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:50.915 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:50.915 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:51.037 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:51.051 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-mirror 2020-04-28T12:39:51.064 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:51.077 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2020-04-28T12:39:51.496 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:52 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:51.517 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:52 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:51.760 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:51.836 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:51.836 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:51.837 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:51.838 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:51.838 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:51.838 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:51.838 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.7 M 2020-04-28T12:39:51.838 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 13 M 2020-04-28T12:39:51.839 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:51.863 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:51.864 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:51.865 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:51.988 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:52.002 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2020-04-28T12:39:52.281 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 6.1 MB/s | 2.7 MB 00:00 2020-04-28T12:39:52.281 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:52.282 INFO:teuthology.orchestra.run.smithi092.stdout:Total 6.1 MB/s | 2.7 MB 00:00 2020-04-28T12:39:52.284 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:52.298 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:52.298 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:52.354 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:52.354 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:52.442 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:53 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:52.686 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:52.708 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:52.788 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:52.789 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:52.789 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:52.914 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:52.928 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2020-04-28T12:39:53.144 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:53.368 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:54 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:53.652 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:39:53.756 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:53.756 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2020-04-28T12:39:53.756 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:53.782 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:53.874 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:53.887 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2020-04-28T12:39:54.331 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:55 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:54.716 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:54.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:54.716 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:54.717 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:54.717 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:54.717 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:55.031 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:55.031 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:55.031 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:55.032 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:55.033 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 72 k 2020-04-28T12:39:55.033 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 230 k 2020-04-28T12:39:55.033 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:55.108 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:39:55.124 INFO:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-nbd 2020-04-28T12:39:55.257 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 323 kB/s | 72 kB 00:00 2020-04-28T12:39:55.257 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:55.257 INFO:teuthology.orchestra.run.smithi138.stdout:Total 321 kB/s | 72 kB 00:00 2020-04-28T12:39:55.259 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:55.270 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:55.270 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:55.318 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:55.319 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:39:55.421 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:39:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:55.572 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:56 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:55.768 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:55.954 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:39:55.955 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:55.955 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2020-04-28T12:39:55.955 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:55.956 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:39:55.956 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:39:55.956 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:55.957 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:39:55.957 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:39:55.957 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2020-04-28T12:39:55.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:55.957 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 141 k 2020-04-28T12:39:55.958 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 526 k 2020-04-28T12:39:55.958 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:39:56.033 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:56.033 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:56.033 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:39:56.033 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:56.034 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:56.034 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:39:56.214 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 545 kB/s | 141 kB 00:00 2020-04-28T12:39:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:56.215 INFO:teuthology.orchestra.run.smithi092.stdout:Total 542 kB/s | 141 kB 00:00 2020-04-28T12:39:56.217 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:39:56.229 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:39:56.229 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:39:56.277 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:39:56.278 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:39:56.305 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:39:56.319 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2020-04-28T12:39:56.400 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:39:56.581 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:56.767 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:57 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:39:56.816 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:39:57.065 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:39:57.113 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:39:57.113 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:57.114 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.7 M 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 13 M 2020-04-28T12:39:57.115 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:39:57.324 DEBUG:teuthology.parallel:result is None 2020-04-28T12:39:59.865 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 1.0 MB/s | 2.7 MB 00:02 2020-04-28T12:39:59.866 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:39:59.867 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.0 MB/s | 2.7 MB 00:02 2020-04-28T12:39:59.869 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:39:59.883 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:39:59.883 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:39:59.945 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:39:59.945 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:40:00.303 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:40:01.298 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:02.201 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:02.419 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:02.420 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:02.420 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:40:02.420 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:40:02.420 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:02.420 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:40:02.696 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:02.711 INFO:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2020-04-28T12:40:03.157 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:04 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:40:03.546 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2020-04-28T12:40:03.547 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:40:03.547 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2020-04-28T12:40:03.547 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:40:03.547 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2020-04-28T12:40:03.547 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 141 k 2020-04-28T12:40:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 526 k 2020-04-28T12:40:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2020-04-28T12:40:04.107 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 253 kB/s | 141 kB 00:00 2020-04-28T12:40:04.107 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:40:04.107 INFO:teuthology.orchestra.run.smithi138.stdout:Total 252 kB/s | 141 kB 00:00 2020-04-28T12:40:04.109 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2020-04-28T12:40:04.120 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2020-04-28T12:40:04.120 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2020-04-28T12:40:04.173 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2020-04-28T12:40:04.173 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2020-04-28T12:40:04.277 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2020-04-28T12:40:04.436 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:04.898 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:40:04.899 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:04.899 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2020-04-28T12:40:04.899 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:40:04.899 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:04.899 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2020-04-28T12:40:05.187 DEBUG:teuthology.parallel:result is None 2020-04-28T12:40:05.188 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:05.201 INFO:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2020-04-28T12:40:05.278 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS 2020-04-28T12:40:05.279 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:40:05.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:40:05.519 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:05.533 INFO:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:40:05.591 INFO:teuthology.orchestra.run.smithi138.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:40:05.592 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:40:05.592 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:40:05.592 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:05.609 INFO:teuthology.orchestra.run.smithi092:> sudo lsb_release -is 2020-04-28T12:40:05.690 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS 2020-04-28T12:40:05.691 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:40:05.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:40:05.920 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:05.935 INFO:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:40:05.995 INFO:teuthology.orchestra.run.smithi092.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:40:05.996 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:40:05.996 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:40:05.996 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-28T12:40:05.996 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:06.010 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:40:06.078 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:06.093 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:40:06.164 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-28T12:40:06.165 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:06.180 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:40:06.247 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:06.300 INFO:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:40:06.367 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:06.382 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:40:06.452 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:06.507 INFO:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:40:06.575 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-28T12:40:06.575 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:06.588 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:40:06.674 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:06.728 INFO:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:40:06.795 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:06.809 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:40:06.894 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:06.948 INFO:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:40:07.015 INFO:teuthology.run_tasks:Running task ceph... 2020-04-28T12:40:07.077 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-28T12:40:07.077 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:07.091 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2020-04-28T12:40:07.133 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.147 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2020-04-28T12:40:07.215 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-28T12:40:07.215 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:07.228 INFO:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:40:07.271 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.285 INFO:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:40:07.352 INFO:tasks.ceph:Creating extra log directories... 2020-04-28T12:40:07.352 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:07.365 INFO:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:40:07.408 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.421 INFO:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:40:07.488 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-28T12:40:07.488 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'lockdep': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}} 2020-04-28T12:40:07.489 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'sleep_before_teardown': 0, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.22147', 'owner': 'scheduled_teuthology@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi092.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz1Jh9Jh56Vg6ly+8sbX+1hnXu6WlArb4GmwsUJkX5FcXAU1PxmHbOxmtmTtC30rmLGJwAyF+IqPdOKhqrowElO2KIl9E0AW3Llqo0BlbDBOI8Q0oylG7xhEJbhmsaI2LACo/lpNk18QVAfi4iPlYqW7honrZcjH6hq6cPn31OQhN2Jl47b0pFOj2/hQ4kV1hGgkwEixtX9CEBdqb6RZo/6cwcDOE07rzay7RoymH/yzCmLUwOX6K4BLkp63NymnxD82S4gArv/bULIG0zcjkgj8767VMX/d2R3DUOkwcNG49ELn7aYQjVEGRN2lL6iFaYF+AehCXGtwCK4Wx6vE1UH873+uqjdRIPXsDdMgUjCgtaE91mtwp2MkC41qf+HpOTwAjANRYLjk/X8Pq5rSZSoh42WYDdVZKu/BFCFAnWnNkqaPgXw/ku99DR7Tpw0Wly4/Md8bJyep74/hHGCa+qf5DPx9GcffI2FlEYo8UXQM0rwnF62NEfElxwrNZlS/U=', 'smithi138.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjsr/4cs5WC2J5qFBSBcR1LypTlpHUu/Up/fZmtCZ1+CUNz/1En6yyTsnwYaO/KMIlbHiTVtnltx1CMUJknsNAhFLz7OnoXUeIxcFUeFeHZhlPO9gTBTHnBq082KeSQX449EuA880HhrJC9KWE73TPHh++tivl/rdHRnb1a8tfbpfXVs89TTCK21fhC8NDSIgm/2J8BwRBbzfFBDOgFgbK4uf/OXXGxe7JIoFDRuUzpb2Nrw+6dFoj4DyDFDgOkHR09lVmIVZWaFeGGA2jHkEwW38YhSCj3AIoqmCXKar/cGc9ZvPygxKEwVlJTo1eUXTrvfheD0l8QGz+Xzx4KpLwIwc3XSO42cp8h0fma4LtEai2kotEA8SqG9+g6MaqrH9hFxGiMC154cWJwfxml7noZpF/pKSGIvxN9IMMOUsEmgeMRuRoYCN6w+JUy03cTYLFjQSoxCayamUvF0ERn8WuIFOH3/w6gsyde1B0k9AyYLaK+r6SrTaIbDFjnSbGxxE='}, 'verbose': True, 'job_id': '4990003', 'tube': 'smithi', 'suite_branch': 'octopus', 'priority': 1000, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'octopus', 'suite': 'rgw', 'email': 'ceph-qa@ceph.io', 'archive_path': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990003', 'description': 'rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'py2', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'name': 'teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'beast', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': True}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'branch': 'octopus'}, 'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'lockdep': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}, 'fs': 'xfs', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}, 'install': {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}}, 'admin_socket': {'branch': 'octopus'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}, 'os_type': 'centos', 'suite_sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:40:07.489 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:07.503 INFO:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:40:07.545 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.558 INFO:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:40:07.612 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:07.625 INFO:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:40:07.667 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.680 INFO:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:40:07.804 DEBUG:teuthology.orchestra.remote:smithi138:/scratch_devs is 72B 2020-04-28T12:40:07.852 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:40:07.852 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.865 INFO:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:40:07.918 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:40:07.918 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:07.918 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 64904 Links: 1 2020-04-28T12:40:07.918 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:07.918 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:07.919 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2020-04-28 12:40:02.034305330 +0000 2020-04-28T12:40:07.919 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2020-04-28 12:37:39.774768269 +0000 2020-04-28T12:40:07.919 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2020-04-28 12:37:39.774768269 +0000 2020-04-28T12:40:07.919 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2020-04-28T12:40:07.931 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2020-04-28T12:40:07.931 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2020-04-28T12:40:07.931 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00021706 s, 2.4 MB/s 2020-04-28T12:40:07.934 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:07.992 INFO:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:40:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:40:08.045 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.045 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 60052 Links: 1 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2020-04-28 12:40:02.035305307 +0000 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2020-04-28 12:37:40.134760395 +0000 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2020-04-28 12:37:40.134760395 +0000 2020-04-28T12:40:08.046 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2020-04-28T12:40:08.058 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2020-04-28T12:40:08.058 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2020-04-28T12:40:08.059 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000203674 s, 2.5 MB/s 2020-04-28T12:40:08.061 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:08.114 INFO:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:40:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 66607 Links: 1 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2020-04-28 12:40:02.035305307 +0000 2020-04-28T12:40:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2020-04-28 12:37:40.455753374 +0000 2020-04-28T12:40:08.169 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2020-04-28 12:37:40.455753374 +0000 2020-04-28T12:40:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2020-04-28T12:40:08.181 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2020-04-28T12:40:08.181 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2020-04-28T12:40:08.181 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00026969 s, 1.9 MB/s 2020-04-28T12:40:08.183 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:08.238 INFO:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 60133 Links: 1 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.292 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2020-04-28 12:40:02.035305307 +0000 2020-04-28T12:40:08.293 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2020-04-28 12:37:40.792746003 +0000 2020-04-28T12:40:08.293 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2020-04-28 12:37:40.792746003 +0000 2020-04-28T12:40:08.293 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2020-04-28T12:40:08.305 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2020-04-28T12:40:08.305 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2020-04-28T12:40:08.305 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000223616 s, 2.3 MB/s 2020-04-28T12:40:08.307 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:08.326 DEBUG:teuthology.orchestra.remote:smithi092:/scratch_devs is 72B 2020-04-28T12:40:08.374 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:40:08.374 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.389 INFO:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:40:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:40:08.445 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.445 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 63125 Links: 1 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2020-04-28 12:39:53.619646023 +0000 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2020-04-28 12:37:39.762298187 +0000 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2020-04-28 12:37:39.762298187 +0000 2020-04-28T12:40:08.446 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2020-04-28T12:40:08.459 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2020-04-28T12:40:08.460 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2020-04-28T12:40:08.460 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000226224 s, 2.3 MB/s 2020-04-28T12:40:08.463 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.517 INFO:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:40:08.571 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:40:08.576 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 67677 Links: 1 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2020-04-28 12:39:53.619646023 +0000 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2020-04-28 12:37:40.086290884 +0000 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2020-04-28 12:37:40.086290884 +0000 2020-04-28T12:40:08.577 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2020-04-28T12:40:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2020-04-28T12:40:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2020-04-28T12:40:08.585 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000203411 s, 2.5 MB/s 2020-04-28T12:40:08.587 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.641 INFO:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 64140 Links: 1 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2020-04-28 12:39:53.619646023 +0000 2020-04-28T12:40:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2020-04-28 12:37:40.423283288 +0000 2020-04-28T12:40:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2020-04-28 12:37:40.423283288 +0000 2020-04-28T12:40:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2020-04-28T12:40:08.710 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2020-04-28T12:40:08.710 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2020-04-28T12:40:08.710 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000199639 s, 2.6 MB/s 2020-04-28T12:40:08.712 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.765 INFO:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:40:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:40:08.818 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 66682 Links: 1 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2020-04-28 12:39:53.619646023 +0000 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2020-04-28 12:37:40.755275805 +0000 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2020-04-28 12:37:40.755275805 +0000 2020-04-28T12:40:08.819 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2020-04-28T12:40:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2020-04-28T12:40:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2020-04-28T12:40:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00021583 s, 2.4 MB/s 2020-04-28T12:40:08.834 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:08.834 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:40:08.834 INFO:tasks.ceph:Generating config... 2020-04-28T12:40:08.835 INFO:tasks.ceph:[mgr] debug ms = 1 2020-04-28T12:40:08.836 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-04-28T12:40:08.836 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2020-04-28T12:40:08.836 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-04-28T12:40:08.836 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2020-04-28T12:40:08.836 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-04-28T12:40:08.836 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1999 2020-04-28T12:40:08.836 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-28T12:40:08.836 INFO:tasks.ceph:[osd] debug ms = 20 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-28T12:40:08.837 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] bdev async discard = True 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] lockdep = True 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-28T12:40:08.838 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-28T12:40:08.839 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-04-28T12:40:08.839 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-28T12:40:08.839 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-28T12:40:08.839 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-28T12:40:08.839 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-28T12:40:08.839 INFO:tasks.ceph:[mon] lockdep = True 2020-04-28T12:40:08.839 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] debug rgw = 20 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2020-04-28T12:40:08.840 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2020-04-28T12:40:08.840 INFO:tasks.ceph:Setting up mon.a... 2020-04-28T12:40:08.841 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.887 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-28T12:40:08.978 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2020-04-28T12:40:08.980 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:08.992 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-28T12:40:09.072 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:09.126 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:40:09.192 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]'), ('mon.b', '172.21.15.138')] 2020-04-28T12:40:09.192 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:09.245 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --add b 172.21.15.138 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:09.320 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid 48c014fa-e1d4-495e-af26-da46e4ba4cfa 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 48c014fa-e1d4-495e-af26-da46e4ba4cfa 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2020-04-28T12:40:09.317663+0000 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:created 2020-04-28T12:40:09.317663+0000 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 0 (unknown) 2020-04-28T12:40:09.321 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2020-04-28T12:40:09.322 INFO:teuthology.orchestra.run.smithi092.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2020-04-28T12:40:09.322 INFO:teuthology.orchestra.run.smithi092.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2020-04-28T12:40:09.322 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-28T12:40:09.323 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 48c014fa-e1d4-495e-af26-da46e4ba4cfa... 2020-04-28T12:40:09.324 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:09.376 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:40:09.418 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:09.434 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:40:09.477 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2020-04-28T12:40:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2020-04-28T12:40:09.477 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:40:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2020-04-28T12:40:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2020-04-28T12:40:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.478 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.479 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.480 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2020-04-28T12:40:09.481 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2020-04-28T12:40:09.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790],172.21.15.138" 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: ms inject socket failures = 5000 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:40:09.483 INFO:teuthology.orchestra.run.smithi092.stdout: mon client directed command retry = 5 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 48c014fa-e1d4-495e-af26-da46e4ba4cfa 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2020-04-28T12:40:09.484 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2020-04-28T12:40:09.485 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2020-04-28T12:40:09.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2020-04-28T12:40:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 20 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 25 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 20 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 20 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2020-04-28T12:40:09.488 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 10 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: osd shutdown pgref assert = True 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: debug journal = 20 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: lockdep = True 2020-04-28T12:40:09.489 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: debug filestore = 20 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2020-04-28T12:40:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.491 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:40:09.492 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: lockdep = True 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2020-04-28T12:40:09.493 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: rgw crypt require ssl = False 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: debug rgw = 20 2020-04-28T12:40:09.494 INFO:teuthology.orchestra.run.smithi092.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: rgw max chunk size = 4194304 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: rgw lc debug interval = 10 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout: rgw obj stripe size = 6291456 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2020-04-28T12:40:09.495 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2020-04-28T12:40:09.532 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2020-04-28T12:40:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2020-04-28T12:40:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2020-04-28T12:40:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:40:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2020-04-28T12:40:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790],172.21.15.138" 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:40:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: ms inject socket failures = 5000 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: mon client directed command retry = 5 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 48c014fa-e1d4-495e-af26-da46e4ba4cfa 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.539 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2020-04-28T12:40:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2020-04-28T12:40:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2020-04-28T12:40:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2020-04-28T12:40:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2020-04-28T12:40:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:40:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2020-04-28T12:40:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2020-04-28T12:40:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2020-04-28T12:40:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2020-04-28T12:40:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 20 2020-04-28T12:40:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 25 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2020-04-28T12:40:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: debug journal = 20 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: lockdep = True 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: debug filestore = 20 2020-04-28T12:40:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2020-04-28T12:40:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2020-04-28T12:40:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2020-04-28T12:40:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:40:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2020-04-28T12:40:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2020-04-28T12:40:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2020-04-28T12:40:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2020-04-28T12:40:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: lockdep = True 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2020-04-28T12:40:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt require ssl = False 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:40:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw = 20 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: rgw max chunk size = 4194304 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: rgw lc debug interval = 10 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: rgw obj stripe size = 6291456 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2020-04-28T12:40:09.554 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2020-04-28T12:40:09.555 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-28T12:40:09.555 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:09.568 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-28T12:40:09.658 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-28T12:40:09.679 DEBUG:teuthology.orchestra.remote:smithi092:/etc/ceph/ceph.keyring is 206B 2020-04-28T12:40:09.783 DEBUG:teuthology.orchestra.remote:smithi092:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-28T12:40:09.831 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:40:09.831 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:09.845 INFO:teuthology.orchestra.run.smithi138:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:40:09.945 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:09.999 INFO:teuthology.orchestra.run.smithi138:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:10.084 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:40:10.084 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:10.097 INFO:teuthology.orchestra.run.smithi092:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:40:10.195 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:10.249 INFO:teuthology.orchestra.run.smithi092:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:10.333 INFO:tasks.ceph:Setting up mon nodes... 2020-04-28T12:40:10.334 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-28T12:40:10.334 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:10.348 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:40:10.457 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:40:10.459 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:10.472 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:40:10.564 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:40:10.566 INFO:tasks.ceph:Setting up mds nodes... 2020-04-28T12:40:10.566 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-28T12:40:10.566 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:10.580 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-04-28T12:40:10.660 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-04-28T12:40:10.675 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:10.689 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-28T12:40:10.768 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-28T12:40:10.783 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-28T12:40:10.783 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:40:10.784 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:10.797 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-28T12:40:10.864 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:10.864 INFO:tasks.ceph:role: osd.4 2020-04-28T12:40:10.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:40:10.865 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:10.918 INFO:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:40:11.434 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:11.434 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:11.434 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:11.434 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2020-04-28T12:40:11.434 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:11.435 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:11.435 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:11.435 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:11.435 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:11.435 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:11.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2020-04-28T12:40:11.436 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:11.449 INFO:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-28T12:40:11.600 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:11.613 INFO:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-28T12:40:11.683 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:11.737 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-28T12:40:11.804 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:11.804 INFO:tasks.ceph:role: osd.5 2020-04-28T12:40:11.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:40:11.804 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:11.857 INFO:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:40:12.374 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:12.374 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:12.375 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:12.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2020-04-28T12:40:12.376 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:12.390 INFO:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-28T12:40:12.492 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:12.506 INFO:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-28T12:40:12.576 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:12.629 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-28T12:40:12.696 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:12.696 INFO:tasks.ceph:role: osd.6 2020-04-28T12:40:12.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:40:12.696 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:12.750 INFO:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:40:13.300 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:13.301 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:13.302 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:13.302 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:13.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2020-04-28T12:40:13.303 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:13.316 INFO:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-28T12:40:13.464 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:13.477 INFO:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-28T12:40:13.547 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:13.601 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-28T12:40:13.668 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:13.668 INFO:tasks.ceph:role: osd.7 2020-04-28T12:40:13.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:40:13.669 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:13.721 INFO:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:40:14.207 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:14.207 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:14.209 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:14.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2020-04-28T12:40:14.210 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:14.227 INFO:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-28T12:40:14.331 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:14.344 INFO:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-28T12:40:14.417 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:14.470 INFO:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:14.554 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.550+0000 7f5b246b1ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-28T12:40:14.555 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.551+0000 7f5b246b1ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-28T12:40:14.555 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.551+0000 7f5b246b1ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:40:14.555 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.551+0000 7f5b246b1ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:40:14.555 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.551+0000 7f5b246b1ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:40:14.556 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:14.552+0000 7f5b246b1ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-28T12:40:16.897 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:16.954 INFO:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-28T12:40:17.025 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:17.081 INFO:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:17.170 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-28T12:40:17.171 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-28T12:40:17.171 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:40:17.171 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:40:17.171 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:40:17.172 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:17.166+0000 7fbbe7bb6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-28T12:40:19.507 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:19.522 INFO:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-28T12:40:19.593 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:19.649 INFO:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:19.737 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.732+0000 7fa666c13ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-28T12:40:19.738 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.733+0000 7fa666c13ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-28T12:40:19.738 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.733+0000 7fa666c13ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:40:19.738 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.733+0000 7fa666c13ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:40:19.738 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.733+0000 7fa666c13ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:40:19.738 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:19.733+0000 7fa666c13ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-28T12:40:22.075 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:22.103 INFO:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-28T12:40:22.174 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:22.229 INFO:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:22.318 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.313+0000 7f46d5f3fec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-28T12:40:22.318 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.313+0000 7f46d5f3fec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-28T12:40:22.319 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.314+0000 7f46d5f3fec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:40:22.319 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.314+0000 7f46d5f3fec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:40:22.319 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.314+0000 7f46d5f3fec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:40:22.319 INFO:teuthology.orchestra.run.smithi138.stderr:2020-04-28T12:40:22.314+0000 7f46d5f3fec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-28T12:40:24.653 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:24.671 INFO:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-28T12:40:24.743 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:24.758 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-28T12:40:24.839 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:24.839 INFO:tasks.ceph:role: osd.0 2020-04-28T12:40:24.839 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:40:24.840 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:24.894 INFO:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:40:25.424 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:25.425 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:25.425 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:25.425 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2020-04-28T12:40:25.425 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:25.425 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:25.426 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:25.426 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:25.426 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:25.426 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:25.427 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2020-04-28T12:40:25.427 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:25.444 INFO:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-28T12:40:25.592 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:25.608 INFO:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-28T12:40:25.685 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:25.739 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-28T12:40:25.810 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:25.810 INFO:tasks.ceph:role: osd.1 2020-04-28T12:40:25.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:40:25.810 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:25.864 INFO:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:40:26.375 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:26.375 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:26.375 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:26.376 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:26.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2020-04-28T12:40:26.377 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:26.392 INFO:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-28T12:40:26.498 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:26.513 INFO:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-28T12:40:26.585 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:26.639 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-28T12:40:26.707 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:26.708 INFO:tasks.ceph:role: osd.2 2020-04-28T12:40:26.708 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:40:26.708 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:26.761 INFO:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:40:27.305 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:27.306 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:27.307 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:27.307 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:27.307 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:27.308 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2020-04-28T12:40:27.308 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:27.324 INFO:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-28T12:40:27.492 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:27.506 INFO:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-28T12:40:27.576 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:27.629 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-28T12:40:27.695 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:40:27.696 INFO:tasks.ceph:role: osd.3 2020-04-28T12:40:27.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:40:27.696 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:27.749 INFO:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:40:28.230 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:40:28.231 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:40:28.236 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:40:28.236 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:40:28.236 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:40:28.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2020-04-28T12:40:28.237 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:28.251 INFO:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-28T12:40:28.356 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:28.369 INFO:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-28T12:40:28.439 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:28.494 INFO:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:28.589 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.585+0000 7f7ecf39eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-28T12:40:28.592 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.588+0000 7f7ecf39eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-28T12:40:28.593 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.588+0000 7f7ecf39eec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:40:28.593 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.588+0000 7f7ecf39eec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:40:28.593 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.588+0000 7f7ecf39eec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:40:28.593 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:28.590+0000 7f7ecf39eec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-28T12:40:30.926 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:30.983 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-28T12:40:31.058 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:31.113 INFO:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.195+0000 7fd3a10b3ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-28T12:40:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.195+0000 7fd3a10b3ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-28T12:40:31.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.195+0000 7fd3a10b3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:40:31.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.195+0000 7fd3a10b3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:40:31.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.195+0000 7fd3a10b3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:40:31.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:31.196+0000 7fd3a10b3ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-28T12:40:33.542 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:33.559 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-28T12:40:33.631 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:33.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.771+0000 7fd473eb9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-28T12:40:33.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.772+0000 7fd473eb9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-28T12:40:33.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.772+0000 7fd473eb9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:40:33.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.772+0000 7fd473eb9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:40:33.777 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.772+0000 7fd473eb9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:40:33.777 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:33.772+0000 7fd473eb9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-28T12:40:36.109 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:36.125 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-28T12:40:36.196 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:36.252 INFO:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:36.342 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.338+0000 7f78f6340ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-28T12:40:36.343 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.338+0000 7f78f6340ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-28T12:40:36.343 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.338+0000 7f78f6340ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:40:36.343 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.338+0000 7f78f6340ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:40:36.343 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.338+0000 7f78f6340ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:40:36.344 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:40:36.339+0000 7f78f6340ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-28T12:40:38.676 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:38.694 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-28T12:40:38.765 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-28T12:40:38.765 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:38.782 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:38.838 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.10b0uEQmNc 2020-04-28T12:40:38.838 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:38.893 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.10b0uEQmNc 2020-04-28T12:40:38.965 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.020 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.10b0uEQmNc 2020-04-28T12:40:39.150 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.10b0uEQmNc is 56B 2020-04-28T12:40:39.198 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.212 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.10b0uEQmNc 2020-04-28T12:40:39.266 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.321 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:39.375 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.aA4oDU147X 2020-04-28T12:40:39.375 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.428 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.aA4oDU147X 2020-04-28T12:40:39.496 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.549 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.aA4oDU147X 2020-04-28T12:40:39.672 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.aA4oDU147X is 56B 2020-04-28T12:40:39.720 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.733 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.aA4oDU147X 2020-04-28T12:40:39.786 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.838 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:39.891 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.LdWXldxA4j 2020-04-28T12:40:39.892 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:39.944 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.LdWXldxA4j 2020-04-28T12:40:40.011 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.065 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.LdWXldxA4j 2020-04-28T12:40:40.188 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.LdWXldxA4j is 56B 2020-04-28T12:40:40.236 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.249 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.LdWXldxA4j 2020-04-28T12:40:40.302 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.354 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.6hfUfJOuiH 2020-04-28T12:40:40.408 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.460 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.6hfUfJOuiH 2020-04-28T12:40:40.528 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.581 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.6hfUfJOuiH 2020-04-28T12:40:40.705 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.6hfUfJOuiH is 56B 2020-04-28T12:40:40.755 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.768 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.6hfUfJOuiH 2020-04-28T12:40:40.820 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.873 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:40.927 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.8ItsfFXVNY 2020-04-28T12:40:40.927 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:40.979 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.8ItsfFXVNY 2020-04-28T12:40:41.047 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:41.100 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.8ItsfFXVNY 2020-04-28T12:40:41.225 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.8ItsfFXVNY is 56B 2020-04-28T12:40:41.277 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:41.293 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.8ItsfFXVNY 2020-04-28T12:40:41.344 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.360 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:41.416 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.JqBzis8awY 2020-04-28T12:40:41.416 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.471 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.JqBzis8awY 2020-04-28T12:40:41.541 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.595 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.JqBzis8awY 2020-04-28T12:40:41.721 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.JqBzis8awY is 56B 2020-04-28T12:40:41.769 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.782 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.JqBzis8awY 2020-04-28T12:40:41.836 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.889 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:41.943 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.JRIsGyltDx 2020-04-28T12:40:41.943 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:41.996 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.JRIsGyltDx 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.116 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.JRIsGyltDx 2020-04-28T12:40:42.241 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.JRIsGyltDx is 56B 2020-04-28T12:40:42.291 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.304 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.JRIsGyltDx 2020-04-28T12:40:42.357 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.409 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:42.463 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.uk4iV7wbv5 2020-04-28T12:40:42.463 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.516 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.uk4iV7wbv5 2020-04-28T12:40:42.582 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.637 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.uk4iV7wbv5 2020-04-28T12:40:42.762 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.uk4iV7wbv5 is 56B 2020-04-28T12:40:42.810 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.825 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.uk4iV7wbv5 2020-04-28T12:40:42.876 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:42.929 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:42.982 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.k5GIRnJscT 2020-04-28T12:40:42.983 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.036 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.k5GIRnJscT 2020-04-28T12:40:43.107 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.161 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.k5GIRnJscT 2020-04-28T12:40:43.284 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.k5GIRnJscT is 56B 2020-04-28T12:40:43.332 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.345 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.k5GIRnJscT 2020-04-28T12:40:43.398 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.451 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:43.504 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.qJPrD16wop 2020-04-28T12:40:43.504 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.557 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.qJPrD16wop 2020-04-28T12:40:43.625 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.678 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.qJPrD16wop 2020-04-28T12:40:43.802 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.qJPrD16wop is 56B 2020-04-28T12:40:43.854 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:43.867 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.qJPrD16wop 2020-04-28T12:40:43.940 DEBUG:teuthology.orchestra.remote:smithi138:/etc/ceph/ceph.client.1.keyring is 59B 2020-04-28T12:40:44.004 DEBUG:teuthology.orchestra.remote:smithi092:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-28T12:40:44.055 INFO:tasks.ceph:Adding keys to all mons... 2020-04-28T12:40:44.055 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.068 INFO:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:40:44.112 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.128 INFO:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:40:44.170 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2020-04-28T12:40:44.171 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAqJKheyCMRGxAAIMT5gcjubjAnYLCTgzg1tg== 2020-04-28T12:40:44.171 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2020-04-28T12:40:44.171 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAuJKheFvzWIBAAQPnNx87+fI864yNJAsh8MQ== 2020-04-28T12:40:44.171 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2020-04-28T12:40:44.171 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAxJKhe6tD4CRAAqskQGXBNI4L9mZavzAkGaw== 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAzJKheKvfBKxAAEnLXrEGLywzt36eR9EyWbw== 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQA2JKhe6pfDEhAANZsZ1Hy/b89f3xvySAep4w== 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAqJKhe8HZwIRAAjjU3wpQICHSuMjJ8+ZosDw== 2020-04-28T12:40:44.172 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQA8JKheVyPzIhAA64FI9B6qaLOo+uReMfAaIw== 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQA/JKhezBCzCxAAerqGDgSPMrZR87X80C6X1g== 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBBJKhe7PMMLhAANrO0S85pNMlFPLcstf4p6Q== 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2020-04-28T12:40:44.173 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBEJKheUvE0FBAAFoeBG7zyzrAexCJVc+V1Jw== 2020-04-28T12:40:44.174 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2020-04-28T12:40:44.174 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAqJKhetR0mJxAAarmD0DiUcsIaZiI+OjOt7A== 2020-04-28T12:40:44.174 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2020-04-28T12:40:44.174 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQAqJKheN1iZLRAA6C525QmV/SriDTxWk0BbWQ== 2020-04-28T12:40:44.197 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2020-04-28T12:40:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAqJKheyCMRGxAAIMT5gcjubjAnYLCTgzg1tg== 2020-04-28T12:40:44.197 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2020-04-28T12:40:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAuJKheFvzWIBAAQPnNx87+fI864yNJAsh8MQ== 2020-04-28T12:40:44.198 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2020-04-28T12:40:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAxJKhe6tD4CRAAqskQGXBNI4L9mZavzAkGaw== 2020-04-28T12:40:44.198 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2020-04-28T12:40:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAzJKheKvfBKxAAEnLXrEGLywzt36eR9EyWbw== 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA2JKhe6pfDEhAANZsZ1Hy/b89f3xvySAep4w== 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAqJKhe8HZwIRAAjjU3wpQICHSuMjJ8+ZosDw== 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA8JKheVyPzIhAA64FI9B6qaLOo+uReMfAaIw== 2020-04-28T12:40:44.199 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA/JKhezBCzCxAAerqGDgSPMrZR87X80C6X1g== 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBBJKhe7PMMLhAANrO0S85pNMlFPLcstf4p6Q== 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBEJKheUvE0FBAAFoeBG7zyzrAexCJVc+V1Jw== 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2020-04-28T12:40:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAqJKhetR0mJxAAarmD0DiUcsIaZiI+OjOt7A== 2020-04-28T12:40:44.201 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2020-04-28T12:40:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAqJKheN1iZLRAA6C525QmV/SriDTxWk0BbWQ== 2020-04-28T12:40:44.202 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.247 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:40:44.289 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.305 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:40:44.397 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.420 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.462 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.477 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.567 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.581 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.623 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.638 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.726 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.740 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.783 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.797 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.883 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:44.896 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:44.939 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:44.952 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.040 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.053 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:40:45.096 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.109 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:40:45.197 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.210 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.252 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.265 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.352 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.366 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.408 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.421 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.508 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.521 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.563 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.576 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.663 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.686 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.728 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.741 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:40:45.829 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:45.843 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:40:45.886 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:45.900 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:40:45.990 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.003 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:40:46.046 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:46.060 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:40:46.149 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-28T12:40:46.149 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:46.162 INFO:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-28T12:40:46.229 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:46.283 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:40:46.376 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:46.390 INFO:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-28T12:40:46.457 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.471 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-28T12:40:46.539 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.593 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:40:46.686 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.699 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-28T12:40:46.767 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.820 INFO:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-28T12:40:46.887 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:46.941 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:40:47.034 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.048 INFO:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-28T12:40:47.115 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.168 INFO:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:47.211 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:47.225 INFO:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:40:47.280 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-28T12:40:47.281 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-28T12:40:47.281 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:47.335 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-28T12:40:47.377 INFO:tasks.ceph.mon.b:Started 2020-04-28T12:40:47.378 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-28T12:40:47.378 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.392 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-28T12:40:47.435 INFO:tasks.ceph.mon.a:Started 2020-04-28T12:40:47.435 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-28T12:40:47.435 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.450 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-28T12:40:47.493 INFO:tasks.ceph.mon.c:Started 2020-04-28T12:40:47.493 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-28T12:40:47.494 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-28T12:40:47.494 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:47.508 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-28T12:40:47.551 INFO:tasks.ceph.mgr.x:Started 2020-04-28T12:40:47.551 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-28T12:40:47.551 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.583 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-28T12:40:47.625 INFO:tasks.ceph.mgr.y:Started 2020-04-28T12:40:47.625 INFO:tasks.ceph:Setting crush tunables to default 2020-04-28T12:40:47.625 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:47.639 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2020-04-28T12:40:52.864 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2020-04-28T12:40:52.874 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-28T12:40:52.874 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:52.904 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:52.960 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.WFEE3f6nHV 2020-04-28T12:40:52.960 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.015 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.WFEE3f6nHV 2020-04-28T12:40:53.086 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.139 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.WFEE3f6nHV 2020-04-28T12:40:53.265 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.WFEE3f6nHV is 37B 2020-04-28T12:40:53.312 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.326 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.WFEE3f6nHV 2020-04-28T12:40:53.383 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.437 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:53.491 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.bGNOHJMaAc 2020-04-28T12:40:53.492 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.545 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.bGNOHJMaAc 2020-04-28T12:40:53.612 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.666 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.bGNOHJMaAc 2020-04-28T12:40:53.791 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.bGNOHJMaAc is 37B 2020-04-28T12:40:53.839 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.852 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.bGNOHJMaAc 2020-04-28T12:40:53.906 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:53.960 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:54.022 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.etZ1LG1IcQ 2020-04-28T12:40:54.022 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.094 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.etZ1LG1IcQ 2020-04-28T12:40:54.165 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.219 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.etZ1LG1IcQ 2020-04-28T12:40:54.343 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.etZ1LG1IcQ is 37B 2020-04-28T12:40:54.392 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.406 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.etZ1LG1IcQ 2020-04-28T12:40:54.460 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.514 INFO:teuthology.orchestra.run.smithi138:> mktemp 2020-04-28T12:40:54.569 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.KjLCggPI92 2020-04-28T12:40:54.569 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.623 INFO:teuthology.orchestra.run.smithi138:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.KjLCggPI92 2020-04-28T12:40:54.694 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.753 INFO:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.KjLCggPI92 2020-04-28T12:40:54.884 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.KjLCggPI92 is 37B 2020-04-28T12:40:54.931 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:54.944 INFO:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.KjLCggPI92 2020-04-28T12:40:54.998 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.011 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:55.069 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.jqobc3auzV 2020-04-28T12:40:55.069 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.122 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.jqobc3auzV 2020-04-28T12:40:55.191 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.244 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.jqobc3auzV 2020-04-28T12:40:55.369 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.jqobc3auzV is 37B 2020-04-28T12:40:55.417 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.430 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.jqobc3auzV 2020-04-28T12:40:55.484 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.537 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:55.591 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.KRoZKjAD0T 2020-04-28T12:40:55.591 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.644 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.KRoZKjAD0T 2020-04-28T12:40:55.713 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.767 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.KRoZKjAD0T 2020-04-28T12:40:55.891 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.KRoZKjAD0T is 37B 2020-04-28T12:40:55.939 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:55.952 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.KRoZKjAD0T 2020-04-28T12:40:56.005 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.058 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:56.112 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.STphZ83ycV 2020-04-28T12:40:56.112 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.165 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.STphZ83ycV 2020-04-28T12:40:56.232 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.285 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.STphZ83ycV 2020-04-28T12:40:56.407 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.STphZ83ycV is 37B 2020-04-28T12:40:56.456 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.469 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.STphZ83ycV 2020-04-28T12:40:56.523 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.577 INFO:teuthology.orchestra.run.smithi092:> mktemp 2020-04-28T12:40:56.630 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.GXMdN8ye4c 2020-04-28T12:40:56.630 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.686 INFO:teuthology.orchestra.run.smithi092:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.GXMdN8ye4c 2020-04-28T12:40:56.753 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.807 INFO:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.GXMdN8ye4c 2020-04-28T12:40:56.930 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.GXMdN8ye4c is 37B 2020-04-28T12:40:56.978 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:56.991 INFO:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.GXMdN8ye4c 2020-04-28T12:40:57.044 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:57.097 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new af1ca313-91bf-452f-868a-2035b74dd5ee 0 2020-04-28T12:40:57.406 INFO:teuthology.orchestra.run.smithi092.stdout:0 2020-04-28T12:40:57.418 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:57.431 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 91d09970-1aff-48e1-9b56-e99a86943d53 1 2020-04-28T12:40:57.741 INFO:teuthology.orchestra.run.smithi092.stdout:1 2020-04-28T12:40:57.752 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:57.766 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 889a8f47-2751-4911-a66f-29f6d2d59b5c 2 2020-04-28T12:40:58.076 INFO:teuthology.orchestra.run.smithi092.stdout:2 2020-04-28T12:40:58.087 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:58.101 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 7476ea5f-5b02-4fc1-9ffb-2e2e377e3323 3 2020-04-28T12:40:58.410 INFO:teuthology.orchestra.run.smithi092.stdout:3 2020-04-28T12:40:58.422 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:58.436 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 30d3a313-d379-460e-8cf0-0a70253e9c99 4 2020-04-28T12:40:58.750 INFO:teuthology.orchestra.run.smithi092.stdout:4 2020-04-28T12:40:58.761 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:58.775 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 5c685d6b-12bc-4f03-a6a1-5e53642d90dc 5 2020-04-28T12:40:59.084 INFO:teuthology.orchestra.run.smithi092.stdout:5 2020-04-28T12:40:59.095 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:59.109 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf 6 2020-04-28T12:40:59.420 INFO:teuthology.orchestra.run.smithi092.stdout:6 2020-04-28T12:40:59.432 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:40:59.446 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 2990dba2-2568-407e-953f-2cbd49816c78 7 2020-04-28T12:40:59.756 INFO:teuthology.orchestra.run.smithi092.stdout:7 2020-04-28T12:40:59.767 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-28T12:40:59.768 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:59.784 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-28T12:40:59.831 INFO:tasks.ceph.osd.4:Started 2020-04-28T12:40:59.831 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-28T12:40:59.831 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:59.849 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-28T12:40:59.892 INFO:tasks.ceph.osd.5:Started 2020-04-28T12:40:59.892 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-28T12:40:59.892 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:59.908 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-28T12:40:59.951 INFO:tasks.ceph.osd.6:Started 2020-04-28T12:40:59.951 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-28T12:40:59.951 INFO:teuthology.orchestra.run.smithi138:> true 2020-04-28T12:40:59.965 INFO:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-28T12:41:00.017 INFO:tasks.ceph.osd.7:Started 2020-04-28T12:41:00.017 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-28T12:41:00.017 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:00.032 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-28T12:41:00.074 INFO:tasks.ceph.osd.0:Started 2020-04-28T12:41:00.074 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-28T12:41:00.075 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:00.089 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-28T12:41:00.132 INFO:tasks.ceph.osd.1:Started 2020-04-28T12:41:00.132 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-28T12:41:00.132 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:00.151 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-28T12:41:00.194 INFO:tasks.ceph.osd.2:Started 2020-04-28T12:41:00.194 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-28T12:41:00.194 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:00.209 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-28T12:41:00.251 INFO:tasks.ceph.osd.3:Started 2020-04-28T12:41:00.251 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-28T12:41:00.427 INFO:tasks.ceph.osd.4.smithi138.stderr:2020-04-28T12:41:00.423+0000 7ff98ca1dec0 -1 Falling back to public interface 2020-04-28T12:41:00.491 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:41:00.481+0000 7f3f77417ec0 -1 Falling back to public interface 2020-04-28T12:41:00.544 INFO:tasks.ceph.osd.6.smithi138.stderr:2020-04-28T12:41:00.540+0000 7fb9722b5ec0 -1 Falling back to public interface 2020-04-28T12:41:00.604 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T12:41:00.600+0000 7f1b43abaec0 -1 Falling back to public interface 2020-04-28T12:41:00.671 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T12:41:00.667+0000 7f50321f9ec0 -1 Falling back to public interface 2020-04-28T12:41:00.724 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T12:41:00.720+0000 7f049a38cec0 -1 Falling back to public interface 2020-04-28T12:41:00.796 INFO:tasks.ceph.osd.2.smithi092.stderr:2020-04-28T12:41:00.791+0000 7fa883e64ec0 -1 Falling back to public interface 2020-04-28T12:41:00.843 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T12:41:00.839+0000 7fc07683eec0 -1 Falling back to public interface 2020-04-28T12:41:01.060 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:01.076 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:41:01.373 INFO:teuthology.misc.health.smithi092.stdout: 2020-04-28T12:41:01.374 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":11,"fsid":"48c014fa-e1d4-495e-af26-da46e4ba4cfa","created":"2020-04-28T12:40:52.745752+0000","modified":"2020-04-28T12:40:59.749627+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:40:55.783120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"af1ca313-91bf-452f-868a-2035b74dd5ee","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"91d09970-1aff-48e1-9b56-e99a86943d53","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"889a8f47-2751-4911-a66f-29f6d2d59b5c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7476ea5f-5b02-4fc1-9ffb-2e2e377e3323","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"30d3a313-d379-460e-8cf0-0a70253e9c99","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c685d6b-12bc-4f03-a6a1-5e53642d90dc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2990dba2-2568-407e-953f-2cbd49816c78","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:41:01.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-28T12:41:01.489 INFO:tasks.ceph.osd.4.smithi138.stderr:2020-04-28T12:41:01.484+0000 7ff98ca1dec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-28T12:41:01.546 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:41:01.541+0000 7f3f77417ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-28T12:41:01.617 INFO:tasks.ceph.osd.6.smithi138.stderr:2020-04-28T12:41:01.608+0000 7fb9722b5ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-28T12:41:01.680 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T12:41:01.676+0000 7f1b43abaec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-28T12:41:01.739 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T12:41:01.734+0000 7f50321f9ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-28T12:41:01.788 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T12:41:01.783+0000 7f049a38cec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-28T12:41:01.867 INFO:tasks.ceph.osd.2.smithi092.stderr:2020-04-28T12:41:01.863+0000 7fa883e64ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-28T12:41:01.911 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T12:41:01.907+0000 7fc07683eec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-28T12:41:03.442 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:41:03.437+0000 7f3f5fbdf700 -1 osd.5 0 waiting for initial osdmap 2020-04-28T12:41:03.442 INFO:tasks.ceph.osd.4.smithi138.stderr:2020-04-28T12:41:03.437+0000 7ff9751e5700 -1 osd.4 0 waiting for initial osdmap 2020-04-28T12:41:03.443 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T12:41:03.438+0000 7f1b2c282700 -1 osd.7 0 waiting for initial osdmap 2020-04-28T12:41:03.443 INFO:tasks.ceph.osd.6.smithi138.stderr:2020-04-28T12:41:03.438+0000 7fb95aa7d700 -1 osd.6 0 waiting for initial osdmap 2020-04-28T12:41:03.444 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T12:41:03.439+0000 7f501a9c1700 -1 osd.0 0 waiting for initial osdmap 2020-04-28T12:41:03.444 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T12:41:03.439+0000 7fc05f006700 -1 osd.3 0 waiting for initial osdmap 2020-04-28T12:41:03.444 INFO:tasks.ceph.osd.2.smithi092.stderr:2020-04-28T12:41:03.440+0000 7fa86c62c700 -1 osd.2 0 waiting for initial osdmap 2020-04-28T12:41:03.445 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T12:41:03.440+0000 7f0482b54700 -1 osd.1 0 waiting for initial osdmap 2020-04-28T12:41:08.193 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:08.210 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:41:08.500 INFO:teuthology.misc.health.smithi092.stdout: 2020-04-28T12:41:08.500 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":16,"fsid":"48c014fa-e1d4-495e-af26-da46e4ba4cfa","created":"2020-04-28T12:40:52.745752+0000","modified":"2020-04-28T12:41:06.449202+0000","last_up_change":"2020-04-28T12:41:04.434565+0000","last_in_change":"2020-04-28T12:41:04.434565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:40:55.783120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"af1ca313-91bf-452f-868a-2035b74dd5ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":23930},{"type":"v1","addr":"172.21.15.92:6803","nonce":23930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":23930},{"type":"v1","addr":"172.21.15.92:6805","nonce":23930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":23930},{"type":"v1","addr":"172.21.15.92:6809","nonce":23930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":23930},{"type":"v1","addr":"172.21.15.92:6807","nonce":23930}]},"public_addr":"172.21.15.92:6803/23930","cluster_addr":"172.21.15.92:6805/23930","heartbeat_back_addr":"172.21.15.92:6809/23930","heartbeat_front_addr":"172.21.15.92:6807/23930","state":["exists","up"]},{"osd":1,"uuid":"91d09970-1aff-48e1-9b56-e99a86943d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":23975},{"type":"v1","addr":"172.21.15.92:6811","nonce":23975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":23975},{"type":"v1","addr":"172.21.15.92:6813","nonce":23975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":23975},{"type":"v1","addr":"172.21.15.92:6817","nonce":23975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":23975},{"type":"v1","addr":"172.21.15.92:6815","nonce":23975}]},"public_addr":"172.21.15.92:6811/23975","cluster_addr":"172.21.15.92:6813/23975","heartbeat_back_addr":"172.21.15.92:6817/23975","heartbeat_front_addr":"172.21.15.92:6815/23975","state":["exists","up"]},{"osd":2,"uuid":"889a8f47-2751-4911-a66f-29f6d2d59b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":24027},{"type":"v1","addr":"172.21.15.92:6819","nonce":24027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24027},{"type":"v1","addr":"172.21.15.92:6821","nonce":24027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24027},{"type":"v1","addr":"172.21.15.92:6825","nonce":24027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":24027},{"type":"v1","addr":"172.21.15.92:6823","nonce":24027}]},"public_addr":"172.21.15.92:6819/24027","cluster_addr":"172.21.15.92:6821/24027","heartbeat_back_addr":"172.21.15.92:6825/24027","heartbeat_front_addr":"172.21.15.92:6823/24027","state":["exists","up"]},{"osd":3,"uuid":"7476ea5f-5b02-4fc1-9ffb-2e2e377e3323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24056},{"type":"v1","addr":"172.21.15.92:6827","nonce":24056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24056},{"type":"v1","addr":"172.21.15.92:6829","nonce":24056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":24056},{"type":"v1","addr":"172.21.15.92:6833","nonce":24056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24056},{"type":"v1","addr":"172.21.15.92:6831","nonce":24056}]},"public_addr":"172.21.15.92:6827/24056","cluster_addr":"172.21.15.92:6829/24056","heartbeat_back_addr":"172.21.15.92:6833/24056","heartbeat_front_addr":"172.21.15.92:6831/24056","state":["exists","up"]},{"osd":4,"uuid":"30d3a313-d379-460e-8cf0-0a70253e9c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":22915},{"type":"v1","addr":"172.21.15.138:6801","nonce":22915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":22915},{"type":"v1","addr":"172.21.15.138:6803","nonce":22915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":22915},{"type":"v1","addr":"172.21.15.138:6807","nonce":22915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":22915},{"type":"v1","addr":"172.21.15.138:6805","nonce":22915}]},"public_addr":"172.21.15.138:6801/22915","cluster_addr":"172.21.15.138:6803/22915","heartbeat_back_addr":"172.21.15.138:6807/22915","heartbeat_front_addr":"172.21.15.138:6805/22915","state":["exists","up"]},{"osd":5,"uuid":"5c685d6b-12bc-4f03-a6a1-5e53642d90dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":22963},{"type":"v1","addr":"172.21.15.138:6809","nonce":22963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":22963},{"type":"v1","addr":"172.21.15.138:6811","nonce":22963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":22963},{"type":"v1","addr":"172.21.15.138:6815","nonce":22963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":22963},{"type":"v1","addr":"172.21.15.138:6813","nonce":22963}]},"public_addr":"172.21.15.138:6809/22963","cluster_addr":"172.21.15.138:6811/22963","heartbeat_back_addr":"172.21.15.138:6815/22963","heartbeat_front_addr":"172.21.15.138:6813/22963","state":["exists","up"]},{"osd":6,"uuid":"3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":23005},{"type":"v1","addr":"172.21.15.138:6817","nonce":23005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":23005},{"type":"v1","addr":"172.21.15.138:6819","nonce":23005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":23005},{"type":"v1","addr":"172.21.15.138:6823","nonce":23005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":23005},{"type":"v1","addr":"172.21.15.138:6821","nonce":23005}]},"public_addr":"172.21.15.138:6817/23005","cluster_addr":"172.21.15.138:6819/23005","heartbeat_back_addr":"172.21.15.138:6823/23005","heartbeat_front_addr":"172.21.15.138:6821/23005","state":["exists","up"]},{"osd":7,"uuid":"2990dba2-2568-407e-953f-2cbd49816c78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":23038},{"type":"v1","addr":"172.21.15.138:6825","nonce":23038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":23038},{"type":"v1","addr":"172.21.15.138:6827","nonce":23038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":23038},{"type":"v1","addr":"172.21.15.138:6831","nonce":23038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":23038},{"type":"v1","addr":"172.21.15.138:6829","nonce":23038}]},"public_addr":"172.21.15.138:6825/23038","cluster_addr":"172.21.15.138:6827/23038","heartbeat_back_addr":"172.21.15.138:6831/23038","heartbeat_front_addr":"172.21.15.138:6829/23038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.742770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.806982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.905514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.873829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.511550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.550299+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.582290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.691385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:41:08.511 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-28T12:41:08.511 INFO:tasks.ceph:Creating RBD pool 2020-04-28T12:41:08.511 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:08.524 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-28T12:41:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'rbd' created 2020-04-28T12:41:09.552 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:09.566 INFO:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-28T12:41:10.546 INFO:teuthology.orchestra.run.smithi092.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-28T12:41:10.556 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-28T12:41:10.557 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:10.557 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-28T12:41:10.570 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:41:10.868 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:10.869 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":18,"fsid":"48c014fa-e1d4-495e-af26-da46e4ba4cfa","created":"2020-04-28T12:40:52.745752+0000","modified":"2020-04-28T12:41:10.531342+0000","last_up_change":"2020-04-28T12:41:04.434565+0000","last_in_change":"2020-04-28T12:41:04.434565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:40:55.783120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:41:08.828226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"af1ca313-91bf-452f-868a-2035b74dd5ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":23930},{"type":"v1","addr":"172.21.15.92:6803","nonce":23930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":23930},{"type":"v1","addr":"172.21.15.92:6805","nonce":23930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":23930},{"type":"v1","addr":"172.21.15.92:6809","nonce":23930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":23930},{"type":"v1","addr":"172.21.15.92:6807","nonce":23930}]},"public_addr":"172.21.15.92:6803/23930","cluster_addr":"172.21.15.92:6805/23930","heartbeat_back_addr":"172.21.15.92:6809/23930","heartbeat_front_addr":"172.21.15.92:6807/23930","state":["exists","up"]},{"osd":1,"uuid":"91d09970-1aff-48e1-9b56-e99a86943d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":23975},{"type":"v1","addr":"172.21.15.92:6811","nonce":23975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":23975},{"type":"v1","addr":"172.21.15.92:6813","nonce":23975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":23975},{"type":"v1","addr":"172.21.15.92:6817","nonce":23975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":23975},{"type":"v1","addr":"172.21.15.92:6815","nonce":23975}]},"public_addr":"172.21.15.92:6811/23975","cluster_addr":"172.21.15.92:6813/23975","heartbeat_back_addr":"172.21.15.92:6817/23975","heartbeat_front_addr":"172.21.15.92:6815/23975","state":["exists","up"]},{"osd":2,"uuid":"889a8f47-2751-4911-a66f-29f6d2d59b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":24027},{"type":"v1","addr":"172.21.15.92:6819","nonce":24027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24027},{"type":"v1","addr":"172.21.15.92:6821","nonce":24027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24027},{"type":"v1","addr":"172.21.15.92:6825","nonce":24027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":24027},{"type":"v1","addr":"172.21.15.92:6823","nonce":24027}]},"public_addr":"172.21.15.92:6819/24027","cluster_addr":"172.21.15.92:6821/24027","heartbeat_back_addr":"172.21.15.92:6825/24027","heartbeat_front_addr":"172.21.15.92:6823/24027","state":["exists","up"]},{"osd":3,"uuid":"7476ea5f-5b02-4fc1-9ffb-2e2e377e3323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24056},{"type":"v1","addr":"172.21.15.92:6827","nonce":24056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24056},{"type":"v1","addr":"172.21.15.92:6829","nonce":24056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":24056},{"type":"v1","addr":"172.21.15.92:6833","nonce":24056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24056},{"type":"v1","addr":"172.21.15.92:6831","nonce":24056}]},"public_addr":"172.21.15.92:6827/24056","cluster_addr":"172.21.15.92:6829/24056","heartbeat_back_addr":"172.21.15.92:6833/24056","heartbeat_front_addr":"172.21.15.92:6831/24056","state":["exists","up"]},{"osd":4,"uuid":"30d3a313-d379-460e-8cf0-0a70253e9c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":22915},{"type":"v1","addr":"172.21.15.138:6801","nonce":22915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":22915},{"type":"v1","addr":"172.21.15.138:6803","nonce":22915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":22915},{"type":"v1","addr":"172.21.15.138:6807","nonce":22915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":22915},{"type":"v1","addr":"172.21.15.138:6805","nonce":22915}]},"public_addr":"172.21.15.138:6801/22915","cluster_addr":"172.21.15.138:6803/22915","heartbeat_back_addr":"172.21.15.138:6807/22915","heartbeat_front_addr":"172.21.15.138:6805/22915","state":["exists","up"]},{"osd":5,"uuid":"5c685d6b-12bc-4f03-a6a1-5e53642d90dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":22963},{"type":"v1","addr":"172.21.15.138:6809","nonce":22963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":22963},{"type":"v1","addr":"172.21.15.138:6811","nonce":22963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":22963},{"type":"v1","addr":"172.21.15.138:6815","nonce":22963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":22963},{"type":"v1","addr":"172.21.15.138:6813","nonce":22963}]},"public_addr":"172.21.15.138:6809/22963","cluster_addr":"172.21.15.138:6811/22963","heartbeat_back_addr":"172.21.15.138:6815/22963","heartbeat_front_addr":"172.21.15.138:6813/22963","state":["exists","up"]},{"osd":6,"uuid":"3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":23005},{"type":"v1","addr":"172.21.15.138:6817","nonce":23005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":23005},{"type":"v1","addr":"172.21.15.138:6819","nonce":23005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":23005},{"type":"v1","addr":"172.21.15.138:6823","nonce":23005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":23005},{"type":"v1","addr":"172.21.15.138:6821","nonce":23005}]},"public_addr":"172.21.15.138:6817/23005","cluster_addr":"172.21.15.138:6819/23005","heartbeat_back_addr":"172.21.15.138:6823/23005","heartbeat_front_addr":"172.21.15.138:6821/23005","state":["exists","up"]},{"osd":7,"uuid":"2990dba2-2568-407e-953f-2cbd49816c78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":23038},{"type":"v1","addr":"172.21.15.138:6825","nonce":23038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":23038},{"type":"v1","addr":"172.21.15.138:6827","nonce":23038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":23038},{"type":"v1","addr":"172.21.15.138:6831","nonce":23038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":23038},{"type":"v1","addr":"172.21.15.138:6829","nonce":23038}]},"public_addr":"172.21.15.138:6825/23038","cluster_addr":"172.21.15.138:6827/23038","heartbeat_back_addr":"172.21.15.138:6831/23038","heartbeat_front_addr":"172.21.15.138:6829/23038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.742770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.806982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.905514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.873829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.511550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.550299+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.582290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.691385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:41:10.881 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:40:55.783120+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:41:08.828226+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-28T12:41:10.881 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:10.894 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-28T12:41:11.190 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2020-04-28T12:41:11.202 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:11.215 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-28T12:41:11.509 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2020-04-28T12:41:11.527 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-28T12:41:11.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-28T12:41:11.527 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:11.540 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-28T12:41:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:11.886 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":22633},{"type":"v1","addr":"172.21.15.92:6801","nonce":22633}]},"active_addr":"172.21.15.92:6801/22633","active_change":"2020-04-28T12:40:55.760057+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":285137030}]},{"addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2551306414}]},{"addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2580127268}]}]}} 2020-04-28T12:41:11.892 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-28T12:41:11.892 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-28T12:41:11.892 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:11.911 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:41:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:12.203 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"48c014fa-e1d4-495e-af26-da46e4ba4cfa","created":"2020-04-28T12:40:52.745752+0000","modified":"2020-04-28T12:41:11.537328+0000","last_up_change":"2020-04-28T12:41:04.434565+0000","last_in_change":"2020-04-28T12:41:04.434565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:40:55.783120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:41:08.828226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"af1ca313-91bf-452f-868a-2035b74dd5ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":23930},{"type":"v1","addr":"172.21.15.92:6803","nonce":23930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":23930},{"type":"v1","addr":"172.21.15.92:6805","nonce":23930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":23930},{"type":"v1","addr":"172.21.15.92:6809","nonce":23930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":23930},{"type":"v1","addr":"172.21.15.92:6807","nonce":23930}]},"public_addr":"172.21.15.92:6803/23930","cluster_addr":"172.21.15.92:6805/23930","heartbeat_back_addr":"172.21.15.92:6809/23930","heartbeat_front_addr":"172.21.15.92:6807/23930","state":["exists","up"]},{"osd":1,"uuid":"91d09970-1aff-48e1-9b56-e99a86943d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":23975},{"type":"v1","addr":"172.21.15.92:6811","nonce":23975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":23975},{"type":"v1","addr":"172.21.15.92:6813","nonce":23975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":23975},{"type":"v1","addr":"172.21.15.92:6817","nonce":23975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":23975},{"type":"v1","addr":"172.21.15.92:6815","nonce":23975}]},"public_addr":"172.21.15.92:6811/23975","cluster_addr":"172.21.15.92:6813/23975","heartbeat_back_addr":"172.21.15.92:6817/23975","heartbeat_front_addr":"172.21.15.92:6815/23975","state":["exists","up"]},{"osd":2,"uuid":"889a8f47-2751-4911-a66f-29f6d2d59b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":24027},{"type":"v1","addr":"172.21.15.92:6819","nonce":24027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24027},{"type":"v1","addr":"172.21.15.92:6821","nonce":24027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24027},{"type":"v1","addr":"172.21.15.92:6825","nonce":24027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":24027},{"type":"v1","addr":"172.21.15.92:6823","nonce":24027}]},"public_addr":"172.21.15.92:6819/24027","cluster_addr":"172.21.15.92:6821/24027","heartbeat_back_addr":"172.21.15.92:6825/24027","heartbeat_front_addr":"172.21.15.92:6823/24027","state":["exists","up"]},{"osd":3,"uuid":"7476ea5f-5b02-4fc1-9ffb-2e2e377e3323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24056},{"type":"v1","addr":"172.21.15.92:6827","nonce":24056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24056},{"type":"v1","addr":"172.21.15.92:6829","nonce":24056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":24056},{"type":"v1","addr":"172.21.15.92:6833","nonce":24056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24056},{"type":"v1","addr":"172.21.15.92:6831","nonce":24056}]},"public_addr":"172.21.15.92:6827/24056","cluster_addr":"172.21.15.92:6829/24056","heartbeat_back_addr":"172.21.15.92:6833/24056","heartbeat_front_addr":"172.21.15.92:6831/24056","state":["exists","up"]},{"osd":4,"uuid":"30d3a313-d379-460e-8cf0-0a70253e9c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":22915},{"type":"v1","addr":"172.21.15.138:6801","nonce":22915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":22915},{"type":"v1","addr":"172.21.15.138:6803","nonce":22915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":22915},{"type":"v1","addr":"172.21.15.138:6807","nonce":22915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":22915},{"type":"v1","addr":"172.21.15.138:6805","nonce":22915}]},"public_addr":"172.21.15.138:6801/22915","cluster_addr":"172.21.15.138:6803/22915","heartbeat_back_addr":"172.21.15.138:6807/22915","heartbeat_front_addr":"172.21.15.138:6805/22915","state":["exists","up"]},{"osd":5,"uuid":"5c685d6b-12bc-4f03-a6a1-5e53642d90dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":22963},{"type":"v1","addr":"172.21.15.138:6809","nonce":22963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":22963},{"type":"v1","addr":"172.21.15.138:6811","nonce":22963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":22963},{"type":"v1","addr":"172.21.15.138:6815","nonce":22963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":22963},{"type":"v1","addr":"172.21.15.138:6813","nonce":22963}]},"public_addr":"172.21.15.138:6809/22963","cluster_addr":"172.21.15.138:6811/22963","heartbeat_back_addr":"172.21.15.138:6815/22963","heartbeat_front_addr":"172.21.15.138:6813/22963","state":["exists","up"]},{"osd":6,"uuid":"3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":23005},{"type":"v1","addr":"172.21.15.138:6817","nonce":23005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":23005},{"type":"v1","addr":"172.21.15.138:6819","nonce":23005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":23005},{"type":"v1","addr":"172.21.15.138:6823","nonce":23005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":23005},{"type":"v1","addr":"172.21.15.138:6821","nonce":23005}]},"public_addr":"172.21.15.138:6817/23005","cluster_addr":"172.21.15.138:6819/23005","heartbeat_back_addr":"172.21.15.138:6823/23005","heartbeat_front_addr":"172.21.15.138:6821/23005","state":["exists","up"]},{"osd":7,"uuid":"2990dba2-2568-407e-953f-2cbd49816c78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":23038},{"type":"v1","addr":"172.21.15.138:6825","nonce":23038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":23038},{"type":"v1","addr":"172.21.15.138:6827","nonce":23038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":23038},{"type":"v1","addr":"172.21.15.138:6831","nonce":23038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":23038},{"type":"v1","addr":"172.21.15.138:6829","nonce":23038}]},"public_addr":"172.21.15.138:6825/23038","cluster_addr":"172.21.15.138:6827/23038","heartbeat_back_addr":"172.21.15.138:6831/23038","heartbeat_front_addr":"172.21.15.138:6829/23038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.742770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.806982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.905514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.873829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.511550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.550299+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.582290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.691385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:41:12.215 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-28T12:41:12.215 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:12.228 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:41:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:12.524 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"48c014fa-e1d4-495e-af26-da46e4ba4cfa","created":"2020-04-28T12:40:52.745752+0000","modified":"2020-04-28T12:41:11.537328+0000","last_up_change":"2020-04-28T12:41:04.434565+0000","last_in_change":"2020-04-28T12:41:04.434565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:40:55.783120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:41:08.828226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"af1ca313-91bf-452f-868a-2035b74dd5ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":23930},{"type":"v1","addr":"172.21.15.92:6803","nonce":23930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":23930},{"type":"v1","addr":"172.21.15.92:6805","nonce":23930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":23930},{"type":"v1","addr":"172.21.15.92:6809","nonce":23930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":23930},{"type":"v1","addr":"172.21.15.92:6807","nonce":23930}]},"public_addr":"172.21.15.92:6803/23930","cluster_addr":"172.21.15.92:6805/23930","heartbeat_back_addr":"172.21.15.92:6809/23930","heartbeat_front_addr":"172.21.15.92:6807/23930","state":["exists","up"]},{"osd":1,"uuid":"91d09970-1aff-48e1-9b56-e99a86943d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":23975},{"type":"v1","addr":"172.21.15.92:6811","nonce":23975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":23975},{"type":"v1","addr":"172.21.15.92:6813","nonce":23975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":23975},{"type":"v1","addr":"172.21.15.92:6817","nonce":23975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":23975},{"type":"v1","addr":"172.21.15.92:6815","nonce":23975}]},"public_addr":"172.21.15.92:6811/23975","cluster_addr":"172.21.15.92:6813/23975","heartbeat_back_addr":"172.21.15.92:6817/23975","heartbeat_front_addr":"172.21.15.92:6815/23975","state":["exists","up"]},{"osd":2,"uuid":"889a8f47-2751-4911-a66f-29f6d2d59b5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":24027},{"type":"v1","addr":"172.21.15.92:6819","nonce":24027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24027},{"type":"v1","addr":"172.21.15.92:6821","nonce":24027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24027},{"type":"v1","addr":"172.21.15.92:6825","nonce":24027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":24027},{"type":"v1","addr":"172.21.15.92:6823","nonce":24027}]},"public_addr":"172.21.15.92:6819/24027","cluster_addr":"172.21.15.92:6821/24027","heartbeat_back_addr":"172.21.15.92:6825/24027","heartbeat_front_addr":"172.21.15.92:6823/24027","state":["exists","up"]},{"osd":3,"uuid":"7476ea5f-5b02-4fc1-9ffb-2e2e377e3323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24056},{"type":"v1","addr":"172.21.15.92:6827","nonce":24056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24056},{"type":"v1","addr":"172.21.15.92:6829","nonce":24056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":24056},{"type":"v1","addr":"172.21.15.92:6833","nonce":24056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24056},{"type":"v1","addr":"172.21.15.92:6831","nonce":24056}]},"public_addr":"172.21.15.92:6827/24056","cluster_addr":"172.21.15.92:6829/24056","heartbeat_back_addr":"172.21.15.92:6833/24056","heartbeat_front_addr":"172.21.15.92:6831/24056","state":["exists","up"]},{"osd":4,"uuid":"30d3a313-d379-460e-8cf0-0a70253e9c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":22915},{"type":"v1","addr":"172.21.15.138:6801","nonce":22915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":22915},{"type":"v1","addr":"172.21.15.138:6803","nonce":22915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":22915},{"type":"v1","addr":"172.21.15.138:6807","nonce":22915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":22915},{"type":"v1","addr":"172.21.15.138:6805","nonce":22915}]},"public_addr":"172.21.15.138:6801/22915","cluster_addr":"172.21.15.138:6803/22915","heartbeat_back_addr":"172.21.15.138:6807/22915","heartbeat_front_addr":"172.21.15.138:6805/22915","state":["exists","up"]},{"osd":5,"uuid":"5c685d6b-12bc-4f03-a6a1-5e53642d90dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":22963},{"type":"v1","addr":"172.21.15.138:6809","nonce":22963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":22963},{"type":"v1","addr":"172.21.15.138:6811","nonce":22963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":22963},{"type":"v1","addr":"172.21.15.138:6815","nonce":22963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":22963},{"type":"v1","addr":"172.21.15.138:6813","nonce":22963}]},"public_addr":"172.21.15.138:6809/22963","cluster_addr":"172.21.15.138:6811/22963","heartbeat_back_addr":"172.21.15.138:6815/22963","heartbeat_front_addr":"172.21.15.138:6813/22963","state":["exists","up"]},{"osd":6,"uuid":"3f8e0ebe-ba1e-4fbc-aafa-9834caa80fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":23005},{"type":"v1","addr":"172.21.15.138:6817","nonce":23005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":23005},{"type":"v1","addr":"172.21.15.138:6819","nonce":23005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":23005},{"type":"v1","addr":"172.21.15.138:6823","nonce":23005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":23005},{"type":"v1","addr":"172.21.15.138:6821","nonce":23005}]},"public_addr":"172.21.15.138:6817/23005","cluster_addr":"172.21.15.138:6819/23005","heartbeat_back_addr":"172.21.15.138:6823/23005","heartbeat_front_addr":"172.21.15.138:6821/23005","state":["exists","up"]},{"osd":7,"uuid":"2990dba2-2568-407e-953f-2cbd49816c78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":23038},{"type":"v1","addr":"172.21.15.138:6825","nonce":23038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":23038},{"type":"v1","addr":"172.21.15.138:6827","nonce":23038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":23038},{"type":"v1","addr":"172.21.15.138:6831","nonce":23038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":23038},{"type":"v1","addr":"172.21.15.138:6829","nonce":23038}]},"public_addr":"172.21.15.138:6825/23038","cluster_addr":"172.21.15.138:6827/23038","heartbeat_back_addr":"172.21.15.138:6831/23038","heartbeat_front_addr":"172.21.15.138:6829/23038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.742770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.806982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.905514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.873829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.511550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.550299+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.582290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:41:02.691385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:41:12.536 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:12.549 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-28T12:41:12.729 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:12.729 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:12.742 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-28T12:41:12.924 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:12.924 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:12.938 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-28T12:41:13.124 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:13.125 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:13.138 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-28T12:41:13.318 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:13.319 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:13.334 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-28T12:41:13.515 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:13.515 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:13.528 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-28T12:41:13.711 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:13.711 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:13.725 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-28T12:41:13.909 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:13.910 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:13.923 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-28T12:41:14.104 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:14.104 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:14.117 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:41:14.411 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:14.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2020-04-28T12:41:14.423 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:14.436 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-28T12:41:14.733 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:14.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2020-04-28T12:41:14.742 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:14.755 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-28T12:41:15.050 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:15.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2020-04-28T12:41:15.061 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:15.074 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-28T12:41:15.370 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:15.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2020-04-28T12:41:15.381 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:15.394 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-28T12:41:15.688 INFO:teuthology.orchestra.run.smithi092.stdout:60129542147 2020-04-28T12:41:15.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.4 2020-04-28T12:41:15.700 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:15.713 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-28T12:41:16.009 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:16.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.5 2020-04-28T12:41:16.021 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:16.034 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-28T12:41:16.327 INFO:teuthology.orchestra.run.smithi092.stdout:60129542149 2020-04-28T12:41:16.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.6 2020-04-28T12:41:16.343 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:16.356 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-28T12:41:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:60129542148 2020-04-28T12:41:16.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.7 2020-04-28T12:41:16.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-28T12:41:16.671 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:16.684 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:41:16.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:16.978 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2020-04-28T12:41:16.987 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2020-04-28T12:41:15.766923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390144,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584576,"statfs":{"total":773094113280,"available":764502605824,"internally_reserved":8589934592,"allocated":1507328,"data_stored":512800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.233048"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.664153+0000","last_change":"2020-04-28T12:41:10.663954+0000","last_active":"2020-04-28T12:41:10.664153+0000","last_peered":"2020-04-28T12:41:10.664153+0000","last_clean":"2020-04-28T12:41:10.664153+0000","last_became_active":"2020-04-28T12:41:10.663559+0000","last_became_peered":"2020-04-28T12:41:10.663559+0000","last_unstale":"2020-04-28T12:41:10.664153+0000","last_undegraded":"2020-04-28T12:41:10.664153+0000","last_fullsized":"2020-04-28T12:41:10.664153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.664592+0000","last_change":"2020-04-28T12:41:10.664345+0000","last_active":"2020-04-28T12:41:10.664592+0000","last_peered":"2020-04-28T12:41:10.664592+0000","last_clean":"2020-04-28T12:41:10.664592+0000","last_became_active":"2020-04-28T12:41:10.663987+0000","last_became_peered":"2020-04-28T12:41:10.663987+0000","last_unstale":"2020-04-28T12:41:10.664592+0000","last_undegraded":"2020-04-28T12:41:10.664592+0000","last_fullsized":"2020-04-28T12:41:10.664592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.543887+0000","last_change":"2020-04-28T12:41:10.543247+0000","last_active":"2020-04-28T12:41:10.543887+0000","last_peered":"2020-04-28T12:41:10.543887+0000","last_clean":"2020-04-28T12:41:10.543887+0000","last_became_active":"2020-04-28T12:41:10.542933+0000","last_became_peered":"2020-04-28T12:41:10.542933+0000","last_unstale":"2020-04-28T12:41:10.543887+0000","last_undegraded":"2020-04-28T12:41:10.543887+0000","last_fullsized":"2020-04-28T12:41:10.543887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.544008+0000","last_change":"2020-04-28T12:41:10.543463+0000","last_active":"2020-04-28T12:41:10.544008+0000","last_peered":"2020-04-28T12:41:10.544008+0000","last_clean":"2020-04-28T12:41:10.544008+0000","last_became_active":"2020-04-28T12:41:10.543112+0000","last_became_peered":"2020-04-28T12:41:10.543112+0000","last_unstale":"2020-04-28T12:41:10.544008+0000","last_undegraded":"2020-04-28T12:41:10.544008+0000","last_fullsized":"2020-04-28T12:41:10.544008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.539908+0000","last_change":"2020-04-28T12:41:05.569915+0000","last_active":"2020-04-28T12:41:10.539908+0000","last_peered":"2020-04-28T12:41:10.539908+0000","last_clean":"2020-04-28T12:41:10.539908+0000","last_became_active":"2020-04-28T12:41:05.569498+0000","last_became_peered":"2020-04-28T12:41:05.569498+0000","last_unstale":"2020-04-28T12:41:10.539908+0000","last_undegraded":"2020-04-28T12:41:10.539908+0000","last_fullsized":"2020-04-28T12:41:10.539908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:40:56.762795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:40:56.762795+0000","last_clean_scrub_stamp":"2020-04-28T12:40:56.762795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.803702+0000","last_change":"2020-04-28T12:41:10.803447+0000","last_active":"2020-04-28T12:41:10.803702+0000","last_peered":"2020-04-28T12:41:10.803702+0000","last_clean":"2020-04-28T12:41:10.803702+0000","last_became_active":"2020-04-28T12:41:10.803047+0000","last_became_peered":"2020-04-28T12:41:10.803047+0000","last_unstale":"2020-04-28T12:41:10.803702+0000","last_undegraded":"2020-04-28T12:41:10.803702+0000","last_fullsized":"2020-04-28T12:41:10.803702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.543816+0000","last_change":"2020-04-28T12:41:10.543471+0000","last_active":"2020-04-28T12:41:10.543816+0000","last_peered":"2020-04-28T12:41:10.543816+0000","last_clean":"2020-04-28T12:41:10.543816+0000","last_became_active":"2020-04-28T12:41:10.543139+0000","last_became_peered":"2020-04-28T12:41:10.543139+0000","last_unstale":"2020-04-28T12:41:10.543816+0000","last_undegraded":"2020-04-28T12:41:10.543816+0000","last_fullsized":"2020-04-28T12:41:10.543816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.643240+0000","last_change":"2020-04-28T12:41:10.642973+0000","last_active":"2020-04-28T12:41:10.643240+0000","last_peered":"2020-04-28T12:41:10.643240+0000","last_clean":"2020-04-28T12:41:10.643240+0000","last_became_active":"2020-04-28T12:41:10.642616+0000","last_became_peered":"2020-04-28T12:41:10.642616+0000","last_unstale":"2020-04-28T12:41:10.643240+0000","last_undegraded":"2020-04-28T12:41:10.643240+0000","last_fullsized":"2020-04-28T12:41:10.643240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.643430+0000","last_change":"2020-04-28T12:41:10.643070+0000","last_active":"2020-04-28T12:41:10.643430+0000","last_peered":"2020-04-28T12:41:10.643430+0000","last_clean":"2020-04-28T12:41:10.643430+0000","last_became_active":"2020-04-28T12:41:10.642610+0000","last_became_peered":"2020-04-28T12:41:10.642610+0000","last_unstale":"2020-04-28T12:41:10.643430+0000","last_undegraded":"2020-04-28T12:41:10.643430+0000","last_fullsized":"2020-04-28T12:41:10.643430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.708}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]}]}]}} 2020-04-28T12:41:16.991 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:17.004 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:41:17.294 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:17.295 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2020-04-28T12:41:17.305 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2020-04-28T12:41:15.766923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390144,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584576,"statfs":{"total":773094113280,"available":764502605824,"internally_reserved":8589934592,"allocated":1507328,"data_stored":512800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.233048"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.664153+0000","last_change":"2020-04-28T12:41:10.663954+0000","last_active":"2020-04-28T12:41:10.664153+0000","last_peered":"2020-04-28T12:41:10.664153+0000","last_clean":"2020-04-28T12:41:10.664153+0000","last_became_active":"2020-04-28T12:41:10.663559+0000","last_became_peered":"2020-04-28T12:41:10.663559+0000","last_unstale":"2020-04-28T12:41:10.664153+0000","last_undegraded":"2020-04-28T12:41:10.664153+0000","last_fullsized":"2020-04-28T12:41:10.664153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.664592+0000","last_change":"2020-04-28T12:41:10.664345+0000","last_active":"2020-04-28T12:41:10.664592+0000","last_peered":"2020-04-28T12:41:10.664592+0000","last_clean":"2020-04-28T12:41:10.664592+0000","last_became_active":"2020-04-28T12:41:10.663987+0000","last_became_peered":"2020-04-28T12:41:10.663987+0000","last_unstale":"2020-04-28T12:41:10.664592+0000","last_undegraded":"2020-04-28T12:41:10.664592+0000","last_fullsized":"2020-04-28T12:41:10.664592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.543887+0000","last_change":"2020-04-28T12:41:10.543247+0000","last_active":"2020-04-28T12:41:10.543887+0000","last_peered":"2020-04-28T12:41:10.543887+0000","last_clean":"2020-04-28T12:41:10.543887+0000","last_became_active":"2020-04-28T12:41:10.542933+0000","last_became_peered":"2020-04-28T12:41:10.542933+0000","last_unstale":"2020-04-28T12:41:10.543887+0000","last_undegraded":"2020-04-28T12:41:10.543887+0000","last_fullsized":"2020-04-28T12:41:10.543887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.544008+0000","last_change":"2020-04-28T12:41:10.543463+0000","last_active":"2020-04-28T12:41:10.544008+0000","last_peered":"2020-04-28T12:41:10.544008+0000","last_clean":"2020-04-28T12:41:10.544008+0000","last_became_active":"2020-04-28T12:41:10.543112+0000","last_became_peered":"2020-04-28T12:41:10.543112+0000","last_unstale":"2020-04-28T12:41:10.544008+0000","last_undegraded":"2020-04-28T12:41:10.544008+0000","last_fullsized":"2020-04-28T12:41:10.544008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.539908+0000","last_change":"2020-04-28T12:41:05.569915+0000","last_active":"2020-04-28T12:41:10.539908+0000","last_peered":"2020-04-28T12:41:10.539908+0000","last_clean":"2020-04-28T12:41:10.539908+0000","last_became_active":"2020-04-28T12:41:05.569498+0000","last_became_peered":"2020-04-28T12:41:05.569498+0000","last_unstale":"2020-04-28T12:41:10.539908+0000","last_undegraded":"2020-04-28T12:41:10.539908+0000","last_fullsized":"2020-04-28T12:41:10.539908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:40:56.762795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:40:56.762795+0000","last_clean_scrub_stamp":"2020-04-28T12:40:56.762795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.803702+0000","last_change":"2020-04-28T12:41:10.803447+0000","last_active":"2020-04-28T12:41:10.803702+0000","last_peered":"2020-04-28T12:41:10.803702+0000","last_clean":"2020-04-28T12:41:10.803702+0000","last_became_active":"2020-04-28T12:41:10.803047+0000","last_became_peered":"2020-04-28T12:41:10.803047+0000","last_unstale":"2020-04-28T12:41:10.803702+0000","last_undegraded":"2020-04-28T12:41:10.803702+0000","last_fullsized":"2020-04-28T12:41:10.803702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.543816+0000","last_change":"2020-04-28T12:41:10.543471+0000","last_active":"2020-04-28T12:41:10.543816+0000","last_peered":"2020-04-28T12:41:10.543816+0000","last_clean":"2020-04-28T12:41:10.543816+0000","last_became_active":"2020-04-28T12:41:10.543139+0000","last_became_peered":"2020-04-28T12:41:10.543139+0000","last_unstale":"2020-04-28T12:41:10.543816+0000","last_undegraded":"2020-04-28T12:41:10.543816+0000","last_fullsized":"2020-04-28T12:41:10.543816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.643240+0000","last_change":"2020-04-28T12:41:10.642973+0000","last_active":"2020-04-28T12:41:10.643240+0000","last_peered":"2020-04-28T12:41:10.643240+0000","last_clean":"2020-04-28T12:41:10.643240+0000","last_became_active":"2020-04-28T12:41:10.642616+0000","last_became_peered":"2020-04-28T12:41:10.642616+0000","last_unstale":"2020-04-28T12:41:10.643240+0000","last_undegraded":"2020-04-28T12:41:10.643240+0000","last_fullsized":"2020-04-28T12:41:10.643240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:41:10.643430+0000","last_change":"2020-04-28T12:41:10.643070+0000","last_active":"2020-04-28T12:41:10.643430+0000","last_peered":"2020-04-28T12:41:10.643430+0000","last_clean":"2020-04-28T12:41:10.643430+0000","last_became_active":"2020-04-28T12:41:10.642610+0000","last_became_peered":"2020-04-28T12:41:10.642610+0000","last_unstale":"2020-04-28T12:41:10.643430+0000","last_undegraded":"2020-04-28T12:41:10.643430+0000","last_fullsized":"2020-04-28T12:41:10.643430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:41:09.523873+0000","last_clean_scrub_stamp":"2020-04-28T12:41:09.523873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.24}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.708}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]}]}]}} 2020-04-28T12:41:17.307 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-28T12:41:17.307 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-28T12:41:17.307 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-28T12:41:17.308 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:17.321 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-28T12:41:17.663 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:41:17.674 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-28T12:41:17.674 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-28T12:41:17.674 INFO:teuthology.run_tasks:Running task openssl_keys... 2020-04-28T12:41:17.688 INFO:teuthology.run_tasks:Running task rgw... 2020-04-28T12:41:17.717 DEBUG:tasks.rgw:config is {'client.0': None} 2020-04-28T12:41:17.718 DEBUG:tasks.rgw:client list is ['client.0'] 2020-04-28T12:41:17.718 INFO:tasks.rgw:Creating data pools 2020-04-28T12:41:17.718 DEBUG:tasks.rgw:Obtaining remote for client client.0 2020-04-28T12:41:17.718 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:17.746 INFO:teuthology.orchestra.run.smithi092:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=2 m=1 --cluster ceph 2020-04-28T12:41:18.542 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:18.555 INFO:teuthology.orchestra.run.smithi092:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2020-04-28T12:41:20.559 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'default.rgw.buckets.data' created 2020-04-28T12:41:20.570 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:20.586 INFO:teuthology.orchestra.run.smithi092:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2020-04-28T12:41:21.571 INFO:teuthology.orchestra.run.smithi092.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-04-28T12:41:21.586 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:21.602 INFO:teuthology.orchestra.run.smithi092:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2020-04-28T12:41:22.555 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'default.rgw.buckets.index' created 2020-04-28T12:41:22.566 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:22.580 INFO:teuthology.orchestra.run.smithi092:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2020-04-28T12:41:23.571 INFO:teuthology.orchestra.run.smithi092.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-04-28T12:41:23.585 DEBUG:tasks.rgw:Pools created 2020-04-28T12:41:23.585 INFO:tasks.rgw:Configuring compression type = random 2020-04-28T12:41:23.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:41:23.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:41:23.585 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:23.600 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:41:23.683 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:23.679+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.553+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.553+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.557+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.557+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.557+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.558+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.559+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.577+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.577+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.577+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.578+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.578+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.578+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.578+0000 7fa737a72180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:41:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.578+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 10 Creating default zonegroup 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 20 get_system_obj_state: rctx=0x7ffe0d6c4160 obj=:.pools.avail state=0x55e346a75170 s->prefetch_data=0 2020-04-28T12:41:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.579+0000 7fa737a72180 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-04-28T12:41:25.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.581+0000 7fa725a5b700 0 -- 172.21.15.92:0/344033091 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7fa71c0090c0 msgr2=0x7fa71c009500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.588+0000 7fa72625c700 0 -- 172.21.15.92:0/344033091 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7fa71c0105a0 msgr2=0x7fa71c0109e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.593+0000 7fa737a72180 10 WARNING: store->list_zones() returned r=-2 2020-04-28T12:41:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.593+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.593+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.597+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.597+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.597+0000 7fa737a72180 10 could not read realm id: (2) No such file or directory 2020-04-28T12:41:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.597+0000 7fa737a72180 10 WARNING: failed to set zone as default, r=-22 2020-04-28T12:41:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.597+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.598+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.606 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.601+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.607 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.602+0000 7fa737a72180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:41:25.607 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.602+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.607 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.602+0000 7fa737a72180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:41:25.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.602+0000 7fa737a72180 20 zonegroup default 2020-04-28T12:41:25.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.602+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:25.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 10 Cannot find current period zone using local zone 2020-04-28T12:41:25.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 10 Using default name default 2020-04-28T12:41:25.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.611 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:25.611 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.603+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:25.611 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.604+0000 7fa737a72180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:41:25.611 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.604+0000 7fa737a72180 20 zone default found 2020-04-28T12:41:25.612 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:25.604+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:27.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:27.567+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:27.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:27.567+0000 7fa737a72180 20 rados->read ofs=0 len=0 2020-04-28T12:41:27.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:27.568+0000 7fa737a72180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:27.574 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:27.568+0000 7fa737a72180 20 started sync module instance, tier type = 2020-04-28T12:41:27.574 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:27.568+0000 7fa737a72180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=0 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=1 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=2 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=3 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=4 2020-04-28T12:41:29.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=5 2020-04-28T12:41:29.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.602+0000 7fa737a72180 20 add_watcher() i=6 2020-04-28T12:41:29.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.604+0000 7fa737a72180 20 add_watcher() i=7 2020-04-28T12:41:29.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.604+0000 7fa737a72180 2 all 8 watchers are set, enabling cache 2020-04-28T12:41:29.609 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.604+0000 7fa737a72180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:29.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.604+0000 7fa737a72180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:29.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:29.604+0000 7fa6f67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:33.622 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.617+0000 7fa737a72180 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-04-28T12:41:33.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.703+0000 7fa66cff9700 20 reqs_thread_entry: start 2020-04-28T12:41:33.708 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.703+0000 7fa65a7fc700 20 reqs_thread_entry: start 2020-04-28T12:41:33.708 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.703+0000 7fa737a72180 20 init_complete bucket index max shards: 1999 2020-04-28T12:41:33.708 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.703+0000 7fa658ff9700 20 reqs_thread_entry: start 2020-04-28T12:41:33.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.717+0000 7fa6f67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:33.722 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.718+0000 7fa737a72180 20 remove_watcher() i=0 2020-04-28T12:41:33.722 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.718+0000 7fa737a72180 2 removed watcher, disabling cache 2020-04-28T12:41:33.724 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.720+0000 7fa737a72180 20 remove_watcher() i=1 2020-04-28T12:41:33.725 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.721+0000 7fa737a72180 20 remove_watcher() i=2 2020-04-28T12:41:33.727 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.723+0000 7fa737a72180 20 remove_watcher() i=3 2020-04-28T12:41:33.728 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.724+0000 7fa737a72180 20 remove_watcher() i=4 2020-04-28T12:41:33.730 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.726+0000 7fa737a72180 20 remove_watcher() i=5 2020-04-28T12:41:33.731 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.727+0000 7fa737a72180 20 remove_watcher() i=6 2020-04-28T12:41:33.733 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.729+0000 7fa737a72180 20 remove_watcher() i=7 2020-04-28T12:41:33.736 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2020-04-28T12:41:33.737 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:41:33.737 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:41:33.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:41:33.737 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:33.794 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-04-28T12:41:33.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.876+0000 7fcdaf505180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:33.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.876+0000 7fcdaf505180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:33.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.880+0000 7fcced7fa700 20 reqs_thread_entry: start 2020-04-28T12:41:33.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.880+0000 7fcdaf505180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.880+0000 7fcdaf505180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.880+0000 7fcdaf505180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.882+0000 7fcdaf505180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:41:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.882+0000 7fcdaf505180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.882+0000 7fcdaf505180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.882+0000 7fcdaf505180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.883+0000 7fcdaf505180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.883+0000 7fcdaf505180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.883+0000 7fcdaf505180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:41:33.893 INFO:teuthology.orchestra.run.smithi092.stdout:{"id":"de5031a7-756e-4627-80ed-dffcaeda1dfb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:41:33.893 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'de5031a7-756e-4627-80ed-dffcaeda1dfb', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:41:33.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:41:33.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:41:33.894 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:33.908 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:41:33.990 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.986+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.992 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.988+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.993 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.988+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.993 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.989+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.993 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.989+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.994 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.990+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.994 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.990+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.998 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:33.991+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:41:34.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:41:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:41:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:41:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.006+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.012 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.007+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.010+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:41:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.010+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.014 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.010+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.010+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.011+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:41:34.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.011+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.011+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.011+0000 7f8142d53180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:41:34.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.011+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 zonegroup default 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.012+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.013+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.013+0000 7f8142d53180 10 Cannot find current period zone using local zone 2020-04-28T12:41:34.018 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.013+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.019 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.013+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.019 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.013+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.014+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.014+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.014+0000 7f8142d53180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.014+0000 7f8142d53180 20 zone default found 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.014+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.020 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.015+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.021 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.015+0000 7f8142d53180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.021 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.015+0000 7f8142d53180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.021 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.015+0000 7f8142d53180 20 started sync module instance, tier type = 2020-04-28T12:41:34.021 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.015+0000 7f8142d53180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:41:34.023 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.019+0000 7f8130d3c700 0 -- 172.21.15.92:0/3720799652 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f81280079d0 msgr2=0x7f8128003150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=0 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=1 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=2 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=3 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=4 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=5 2020-04-28T12:41:34.031 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.026+0000 7f8142d53180 20 add_watcher() i=6 2020-04-28T12:41:34.032 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.028+0000 7f8142d53180 20 add_watcher() i=7 2020-04-28T12:41:34.032 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.028+0000 7f8142d53180 2 all 8 watchers are set, enabling cache 2020-04-28T12:41:34.032 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.028+0000 7f8142d53180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:34.033 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.028+0000 7f8142d53180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:34.033 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.028+0000 7f81017e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:34.033 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.029+0000 7f8130d3c700 0 -- 172.21.15.92:0/1252821032 >> v2:172.21.15.92:3300/0 conn(0x563603f5fa00 msgr2=0x563603f60870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:41:34.234 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.230+0000 7f8130d3c700 0 --2- 172.21.15.92:0/1252821032 >> v2:172.21.15.92:3300/0 conn(0x563603f5fa00 0x563603f60870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-28T12:41:34.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.280+0000 7f80737fe700 20 reqs_thread_entry: start 2020-04-28T12:41:34.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.280+0000 7f80717fa700 20 reqs_thread_entry: start 2020-04-28T12:41:34.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.280+0000 7f8142d53180 20 init_complete bucket index max shards: 1999 2020-04-28T12:41:34.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.281+0000 7f805f7fe700 20 reqs_thread_entry: start 2020-04-28T12:41:34.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.294+0000 7f81017e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:34.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.295+0000 7f8142d53180 20 remove_watcher() i=0 2020-04-28T12:41:34.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.295+0000 7f8142d53180 2 removed watcher, disabling cache 2020-04-28T12:41:34.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.296+0000 7f8142d53180 20 remove_watcher() i=1 2020-04-28T12:41:34.301 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.298+0000 7f8142d53180 20 remove_watcher() i=2 2020-04-28T12:41:34.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.299+0000 7f8142d53180 20 remove_watcher() i=3 2020-04-28T12:41:34.304 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.300+0000 7f8142d53180 20 remove_watcher() i=4 2020-04-28T12:41:34.306 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.302+0000 7f8142d53180 20 remove_watcher() i=5 2020-04-28T12:41:34.307 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.303+0000 7f8142d53180 20 remove_watcher() i=6 2020-04-28T12:41:34.308 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.304+0000 7f8142d53180 20 remove_watcher() i=7 2020-04-28T12:41:34.312 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2020-04-28T12:41:34.313 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:41:34.313 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2020-04-28T12:41:34.313 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:41:34.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:41:34.313 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.366 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2020-04-28T12:41:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.450+0000 7ffbab91e180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:34.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.450+0000 7ffbab91e180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:34.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.453+0000 7ffbab91e180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.453+0000 7ffae1ffb700 20 reqs_thread_entry: start 2020-04-28T12:41:34.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.454+0000 7ffbab91e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.454+0000 7ffbab91e180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.455+0000 7ffbab91e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.455+0000 7ffbab91e180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.455+0000 7ffbab91e180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.455+0000 7ffbab91e180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.456+0000 7ffbab91e180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:41:34.465 INFO:teuthology.orchestra.run.smithi092.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2020-04-28T12:41:34.465 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:41:34.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:41:34.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:41:34.466 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.479 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.563+0000 7fcb47330180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.563+0000 7fcb47330180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:34.571 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.567+0000 7fca9d7fa700 20 reqs_thread_entry: start 2020-04-28T12:41:34.571 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.567+0000 7fcb47330180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.571 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.568+0000 7fcb47330180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.572 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.568+0000 7fcb47330180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.572 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.568+0000 7fcb47330180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:41:34.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.568+0000 7fcb47330180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.569+0000 7fcb47330180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.569+0000 7fcb47330180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.569+0000 7fcb47330180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.573 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.569+0000 7fcb47330180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.575 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.571+0000 7fcb47330180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:41:34.580 INFO:teuthology.orchestra.run.smithi092.stdout:{"id":"de5031a7-756e-4627-80ed-dffcaeda1dfb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:41:34.580 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'de5031a7-756e-4627-80ed-dffcaeda1dfb', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:41:34.580 INFO:tasks.rgw:Configuring storage class type = FROZEN 2020-04-28T12:41:34.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:41:34.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:41:34.581 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.594 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2020-04-28T12:41:34.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.676+0000 7fa555ada180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:34.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.676+0000 7fa555ada180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:34.683 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.679+0000 7fa48b7fe700 20 reqs_thread_entry: start 2020-04-28T12:41:34.683 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.679+0000 7fa555ada180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.684 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.680+0000 7fa555ada180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.684 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.680+0000 7fa555ada180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.685 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.681+0000 7fa555ada180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.685 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.681+0000 7fa555ada180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.685 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.682+0000 7fa555ada180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:41:34.686 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.682+0000 7fa555ada180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.686 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.682+0000 7fa555ada180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:41:34.691 INFO:teuthology.orchestra.run.smithi092.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2020-04-28T12:41:34.691 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:41:34.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:41:34.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:41:34.692 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.705 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2020-04-28T12:41:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.788+0000 7f82936d7180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.788+0000 7f82936d7180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:34.795 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.791+0000 7f81f97fa700 20 reqs_thread_entry: start 2020-04-28T12:41:34.795 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.791+0000 7f82936d7180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.796 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.792+0000 7f82936d7180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.796 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.792+0000 7f82936d7180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.793+0000 7f82936d7180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:41:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.793+0000 7f82936d7180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.793+0000 7f82936d7180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.793+0000 7f82936d7180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.794+0000 7f82936d7180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.794+0000 7f82936d7180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:41:34.797+0000 7f82936d7180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:41:34.810 INFO:teuthology.orchestra.run.smithi092.stdout:{"id":"de5031a7-756e-4627-80ed-dffcaeda1dfb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:41:34.815 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'de5031a7-756e-4627-80ed-dffcaeda1dfb', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:41:34.815 INFO:tasks.rgw:Starting rgw... 2020-04-28T12:41:34.815 INFO:tasks.rgw:rgw client.0 config is {} 2020-04-28T12:41:34.815 INFO:tasks.rgw:Using beast as radosgw frontend 2020-04-28T12:41:34.815 INFO:tasks.rgw.client.0:Restarting daemon 2020-04-28T12:41:34.816 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.829 INFO:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2020-04-28T12:41:34.871 INFO:tasks.rgw.client.0:Started 2020-04-28T12:41:34.872 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi092.front.sepia.ceph.com:80/ 2020-04-28T12:41:34.872 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:34.891 INFO:teuthology.orchestra.run.smithi092:> curl http://smithi092.front.sepia.ceph.com:80/ 2020-04-28T12:41:34.957 INFO:teuthology.orchestra.run.smithi092.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:41:34.958 INFO:teuthology.orchestra.run.smithi092.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:41:34.958 INFO:teuthology.orchestra.run.smithi092.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi092.front.sepia.ceph.com port 80: Connection refused 2020-04-28T12:41:34.958 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-04-28T12:41:35.961 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:35.975 INFO:teuthology.orchestra.run.smithi092:> curl http://smithi092.front.sepia.ceph.com:80/ 2020-04-28T12:41:36.044 INFO:teuthology.orchestra.run.smithi092.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:41:36.044 INFO:teuthology.orchestra.run.smithi092.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:41:36.044 INFO:teuthology.orchestra.run.smithi092.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2020-04-28T12:41:36.044 INFO:teuthology.orchestra.run.smithi092.stdout:anonymous 2020-04-28T12:41:36.045 INFO:teuthology.run_tasks:Running task workunit... 2020-04-28T12:41:36.057 INFO:tasks.workunit:Pulling workunits from ref a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:41:36.058 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-28T12:41:36.058 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:36.098 INFO:teuthology.orchestra.run.smithi092:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:41:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-28T12:41:36.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:41:36.152 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:36.207 INFO:teuthology.orchestra.run.smithi092:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:41:36.262 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-04-28T12:41:36.263 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:36.316 INFO:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-04-28T12:41:36.369 INFO:tasks.workunit:timeout=3h 2020-04-28T12:41:36.370 INFO:tasks.workunit:cleanup=True 2020-04-28T12:41:36.370 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:41:36.423 INFO:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:41:36.537 INFO:tasks.workunit.client.0.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-28T12:42:56.694 INFO:tasks.workunit.client.0.smithi092.stderr:Note: checking out 'a8c125c7d78f5cd973863993d258cd717ade4c99'. 2020-04-28T12:42:56.694 INFO:tasks.workunit.client.0.smithi092.stderr: 2020-04-28T12:42:56.694 INFO:tasks.workunit.client.0.smithi092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-28T12:42:56.694 INFO:tasks.workunit.client.0.smithi092.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr:state without impacting any branches by performing another checkout. 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr: 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr: 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr: git checkout -b 2020-04-28T12:42:56.695 INFO:tasks.workunit.client.0.smithi092.stderr: 2020-04-28T12:42:56.696 INFO:tasks.workunit.client.0.smithi092.stderr:HEAD is now at a8c125c7d7 Merge pull request #34750 from yuriw/wip-yuriw-distro-octupus 2020-04-28T12:42:56.698 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:42:56.719 INFO:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-28T12:42:56.779 INFO:tasks.workunit.client.0.smithi092.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-28T12:42:56.781 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:42:56.781 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-28T12:42:57.436 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-28T12:42:57.494 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-28T12:42:57.535 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:42:57.536 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:42:57.537 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-28T12:42:57.577 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:42:57.637 DEBUG:teuthology.orchestra.remote:smithi092:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-28T12:42:57.685 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2020-04-28T12:42:57.685 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2020-04-28T12:42:57.685 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:42:57.698 INFO:teuthology.orchestra.run.smithi092:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2020-04-28T12:42:57.764 INFO:tasks.workunit.client.0.smithi092.stdout:Running main() from gmock_main.cc 2020-04-28T12:42:57.764 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 11 tests from 1 test suite. 2020-04-28T12:42:57.765 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:42:57.765 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 11 tests from ClsLock 2020-04-28T12:42:57.765 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestMultiLocking 2020-04-28T12:42:59.669 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:42:59.669 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: exclusive 2020-04-28T12:42:59.669 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:42:59.669 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:42:59.670 INFO:tasks.workunit.client.0.smithi092.stdout: client.4677 expiration=2020-04-28T12:44:59.660792+0000 addr=v1:172.21.15.92:0/2311261254 cookie= 2020-04-28T12:42:59.674 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:42:59.675 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: shared 2020-04-28T12:42:59.675 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:42:59.675 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:42:59.675 INFO:tasks.workunit.client.0.smithi092.stdout: client.4510 expiration=0.000000 addr=v1:172.21.15.92:0/3108904302 cookie= 2020-04-28T12:42:59.675 INFO:tasks.workunit.client.0.smithi092.stdout: client.4677 expiration=2020-04-28T12:44:59.669675+0000 addr=v1:172.21.15.92:0/2311261254 cookie= 2020-04-28T12:42:59.676 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:42:59.677 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: shared 2020-04-28T12:42:59.677 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:42:59.677 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:42:59.677 INFO:tasks.workunit.client.0.smithi092.stdout: client.4510 expiration=0.000000 addr=v1:172.21.15.92:0/3108904302 cookie= 2020-04-28T12:43:00.646 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestMultiLocking (2881 ms) 2020-04-28T12:43:00.646 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestMeta 2020-04-28T12:43:02.707 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:43:02.707 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: shared 2020-04-28T12:43:02.707 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:43:02.707 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:43:02.707 INFO:tasks.workunit.client.0.smithi092.stdout: client.4695 expiration=0.000000 addr=v1:172.21.15.92:0/20950725 cookie= 2020-04-28T12:43:02.708 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:43:02.708 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: exclusive 2020-04-28T12:43:02.708 INFO:tasks.workunit.client.0.smithi092.stdout: tag: new_tag 2020-04-28T12:43:02.708 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:43:02.708 INFO:tasks.workunit.client.0.smithi092.stdout: client.4692 expiration=0.000000 addr=v1:172.21.15.92:0/3139584433 cookie= 2020-04-28T12:43:03.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestMeta (3017 ms) 2020-04-28T12:43:03.662 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestCookie 2020-04-28T12:43:05.699 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:43:05.700 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: exclusive 2020-04-28T12:43:05.700 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:43:05.700 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout:lock: mylock 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout: lock_type: shared 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout: tag: 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout: lockers: 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout: client.4403 expiration=0.000000 addr=v1:172.21.15.92:0/3241394034 cookie= 2020-04-28T12:43:05.703 INFO:tasks.workunit.client.0.smithi092.stdout: client.4403 expiration=0.000000 addr=v1:172.21.15.92:0/3241394034 cookie=new cookie 2020-04-28T12:43:06.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestCookie (3021 ms) 2020-04-28T12:43:06.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestMultipleLocks 2020-04-28T12:43:09.701 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestMultipleLocks (3018 ms) 2020-04-28T12:43:09.701 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestLockDuration 2020-04-28T12:43:17.752 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestLockDuration (8049 ms) 2020-04-28T12:43:17.753 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestAssertLocked 2020-04-28T12:43:20.772 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestAssertLocked (3022 ms) 2020-04-28T12:43:20.772 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestSetCookie 2020-04-28T12:43:23.795 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestSetCookie (3023 ms) 2020-04-28T12:43:23.795 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestRenew 2020-04-28T12:43:44.577 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestRenew (20782 ms) 2020-04-28T12:43:44.578 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2020-04-28T12:43:51.611 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7033 ms) 2020-04-28T12:43:51.611 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2020-04-28T12:43:59.657 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8046 ms) 2020-04-28T12:43:59.657 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2020-04-28T12:44:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8040 ms) 2020-04-28T12:44:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 11 tests from ClsLock (69932 ms total) 2020-04-28T12:44:07.697 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:44:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:44:07.697 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 11 tests from 1 test suite ran. (69932 ms total) 2020-04-28T12:44:07.698 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 11 tests. 2020-04-28T12:44:07.699 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:07.755 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:44:07.755 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:44:07.862 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2020-04-28T12:44:07.863 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2020-04-28T12:44:07.863 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:07.886 INFO:teuthology.orchestra.run.smithi092:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2020-04-28T12:44:07.954 INFO:tasks.workunit.client.0.smithi092.stdout:Running main() from gmock_main.cc 2020-04-28T12:44:07.955 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:44:07.955 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:44:07.955 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from cls_log 2020-04-28T12:44:07.955 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_log.test_log_add_same_time 2020-04-28T12:44:10.732 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_log.test_log_add_same_time (2777 ms) 2020-04-28T12:44:10.732 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_log.test_log_add_different_time 2020-04-28T12:44:13.744 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_log.test_log_add_different_time (3012 ms) 2020-04-28T12:44:13.744 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_log.trim_by_time 2020-04-28T12:44:16.772 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_log.trim_by_time (3029 ms) 2020-04-28T12:44:16.772 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_log.trim_by_marker 2020-04-28T12:44:19.780 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_log.trim_by_marker (3008 ms) 2020-04-28T12:44:19.780 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from cls_log (11826 ms total) 2020-04-28T12:44:19.781 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:44:19.781 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:44:19.781 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 4 tests from 1 test suite ran. (11826 ms total) 2020-04-28T12:44:19.781 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 4 tests. 2020-04-28T12:44:19.783 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:19.841 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:44:19.841 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:44:19.917 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2020-04-28T12:44:19.917 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2020-04-28T12:44:19.917 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:19.969 INFO:teuthology.orchestra.run.smithi092:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2020-04-28T12:44:20.035 INFO:tasks.workunit.client.0.smithi092.stdout:Running main() from gmock_main.cc 2020-04-28T12:44:20.035 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:44:20.036 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:44:20.036 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 5 tests from cls_rgw 2020-04-28T12:44:20.036 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.test_implicit 2020-04-28T12:44:22.820 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.test_implicit (2785 ms) 2020-04-28T12:44:22.821 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2020-04-28T12:44:25.836 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3016 ms) 2020-04-28T12:44:25.837 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.test_put_snap 2020-04-28T12:44:32.087 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T12:44:32.082+0000 7fc051fec700 -1 osd.3 pg_epoch: 96 pg[26.6( v 95'4 (0'0,95'4] local-lis/les=92/93 n=2 ec=92/92 lis/c=92/92 les/c/f=93/93/0 sis=92) [3,2] r=0 lpr=92 crt=94'3 lcod 94'3 mlcod 94'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2020-04-28T12:44:33.893 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.test_put_snap (8056 ms) 2020-04-28T12:44:33.893 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.test_explicit 2020-04-28T12:44:36.920 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.test_explicit (3025 ms) 2020-04-28T12:44:36.921 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.set 2020-04-28T12:44:39.953 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.set (3035 ms) 2020-04-28T12:44:39.953 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 5 tests from cls_rgw (19917 ms total) 2020-04-28T12:44:39.953 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:44:39.953 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:44:39.953 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 5 tests from 1 test suite ran. (19917 ms total) 2020-04-28T12:44:39.954 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 5 tests. 2020-04-28T12:44:39.955 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:40.011 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:44:40.013 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:44:40.089 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2020-04-28T12:44:40.092 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2020-04-28T12:44:40.092 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:44:40.140 INFO:teuthology.orchestra.run.smithi092:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2020-04-28T12:44:40.215 INFO:tasks.workunit.client.0.smithi092.stdout:Running main() from gmock_main.cc 2020-04-28T12:44:40.215 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 14 tests from 1 test suite. 2020-04-28T12:44:40.215 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:44:40.215 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 14 tests from cls_rgw 2020-04-28T12:44:41.964 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_basic 2020-04-28T12:44:42.024 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_basic (60 ms) 2020-04-28T12:44:42.025 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2020-04-28T12:44:42.069 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (45 ms) 2020-04-28T12:44:42.070 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_remove_object 2020-04-28T12:44:42.121 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_remove_object (51 ms) 2020-04-28T12:44:42.121 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_suggest 2020-04-28T12:44:43.704 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_suggest (1583 ms) 2020-04-28T12:44:43.704 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_list 2020-04-28T12:44:43.733 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_list (30 ms) 2020-04-28T12:44:43.733 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.index_list_delimited 2020-04-28T12:45:12.451 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.index_list_delimited (28717 ms) 2020-04-28T12:45:12.451 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.bi_list 2020-04-28T12:45:12.547 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.bi_list (96 ms) 2020-04-28T12:45:12.547 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.gc_set 2020-04-28T12:45:12.765 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.gc_set (217 ms) 2020-04-28T12:45:12.765 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.gc_list 2020-04-28T12:45:12.781 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.gc_list (16 ms) 2020-04-28T12:45:12.781 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.gc_defer 2020-04-28T12:45:20.643 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.gc_defer (7862 ms) 2020-04-28T12:45:20.643 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.usage_basic 2020-04-28T12:45:20.736 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.usage_basic (93 ms) 2020-04-28T12:45:20.736 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2020-04-28T12:45:20.743 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.usage_clear_no_obj (8 ms) 2020-04-28T12:45:20.743 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.usage_clear 2020-04-28T12:45:20.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.usage_clear (136 ms) 2020-04-28T12:45:20.880 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] cls_rgw.bi_log_trim 2020-04-28T12:45:20.946 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] cls_rgw.bi_log_trim (65 ms) 2020-04-28T12:45:21.651 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 14 tests from cls_rgw (38980 ms total) 2020-04-28T12:45:21.651 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:45:21.651 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:45:21.651 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 14 tests from 1 test suite ran. (41436 ms total) 2020-04-28T12:45:21.651 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 14 tests. 2020-04-28T12:45:21.652 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:21.715 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:45:21.716 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:45:21.796 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2020-04-28T12:45:21.796 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2020-04-28T12:45:21.796 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:21.849 INFO:teuthology.orchestra.run.smithi092:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2020-04-28T12:45:21.931 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 6 tests from 1 test suite. 2020-04-28T12:45:21.932 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:45:23.659 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 6 tests from rgw_gc_log 2020-04-28T12:45:23.659 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2020-04-28T12:45:23.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.init_existing_queue (24 ms) 2020-04-28T12:45:23.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2020-04-28T12:45:23.688 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2020-04-28T12:45:23.688 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2020-04-28T12:45:23.692 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2020-04-28T12:45:23.692 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2020-04-28T12:45:23.694 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2020-04-28T12:45:23.695 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2020-04-28T12:45:23.698 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2020-04-28T12:45:23.698 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2020-04-28T12:45:23.699 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2020-04-28T12:45:23.700 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 6 tests from rgw_gc_log (41 ms total) 2020-04-28T12:45:23.700 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:45:23.701 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:45:24.683 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 6 tests from 1 test suite ran. (2751 ms total) 2020-04-28T12:45:24.683 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 6 tests. 2020-04-28T12:45:24.685 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:24.739 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:45:24.739 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:45:24.814 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2020-04-28T12:45:24.814 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2020-04-28T12:45:24.814 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:24.860 INFO:teuthology.orchestra.run.smithi092:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2020-04-28T12:45:24.934 INFO:tasks.workunit.client.0.smithi092.stdout:Running main() from gmock_main.cc 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestRGWObj 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestRGWObj.underscore 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.935 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i= 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i= 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.936 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i= 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.937 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.938 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:24.939 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.940 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.941 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.942 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.942 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.942 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:24.942 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.942 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.946 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.946 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.947 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.948 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.949 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.950 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.951 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i= 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i= 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i= 2020-04-28T12:45:24.952 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.953 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.954 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.955 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.955 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.955 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.955 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.956 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:24.956 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.956 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.957 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.958 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.959 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.960 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.960 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.960 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.960 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.960 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.961 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.962 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:24.962 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.962 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.962 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.963 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.964 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.964 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.964 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.964 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.964 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.965 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i=v1 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i=v1 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns= i=v1 2020-04-28T12:45:24.966 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.967 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.968 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.969 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.970 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.970 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.970 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.970 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.970 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.971 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.972 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.973 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.974 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.975 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.976 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.977 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:45:24.978 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: _obj[v1] 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.979 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.980 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.981 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.982 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:24.982 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.982 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.982 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.982 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.983 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.984 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.985 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.986 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:24.987 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.988 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_obj", 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:24.989 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestRGWObj.no_underscore 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.990 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i= 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i= 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i= 2020-04-28T12:45:24.991 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.992 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.993 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:24.994 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.995 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.996 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:24.996 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.996 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.996 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:24.996 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:24.997 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:24.997 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:24.997 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:24.997 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:24.998 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:24.998 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:24.998 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:24.998 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:24.998 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:24.999 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:24.999 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:24.999 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:24.999 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:24.999 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.000 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.000 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.000 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.001 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.001 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.001 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.001 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.001 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.002 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:25.002 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.002 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.002 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.003 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.003 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.003 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.003 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.004 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.004 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.004 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.004 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.005 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.005 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.005 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.005 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.005 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.006 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.006 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.006 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.006 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.006 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i= 2020-04-28T12:45:25.008 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.008 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.008 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i= 2020-04-28T12:45:25.008 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.008 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj 2020-04-28T12:45:25.009 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i= 2020-04-28T12:45:25.009 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.009 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:25.009 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.010 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.010 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.010 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.010 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.010 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.011 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.011 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.011 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.011 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.011 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.012 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.013 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:25.013 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.013 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.013 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.014 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.015 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.016 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.017 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.018 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.019 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i=v1 2020-04-28T12:45:25.021 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i=v1 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns= i=v1 2020-04-28T12:45:25.022 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.023 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:25.023 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.023 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.023 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.023 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.024 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.025 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.026 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.027 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.028 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.029 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.030 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.031 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.032 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.033 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.034 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.034 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.034 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:45:25.034 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.034 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout:parsed: obj[v1] 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout: "obj1": { 2020-04-28T12:45:25.035 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.036 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.037 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.038 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.038 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.038 INFO:tasks.workunit.client.0.smithi092.stdout: "obj2": { 2020-04-28T12:45:25.038 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.038 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.039 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.039 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.039 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.039 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.040 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.040 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.040 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.040 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.040 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.041 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.041 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.041 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.041 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.041 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.042 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.042 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3": { 2020-04-28T12:45:25.042 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.042 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.043 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.043 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.043 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.043 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.044 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.044 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.044 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.045 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.045 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.045 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.045 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.046 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.046 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.046 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.046 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "obj3-2": { 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.047 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.048 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "obj", 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "v1", 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestRGWObj.obj_to_raw 2020-04-28T12:45:25.049 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.050 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.051 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.052 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.053 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.054 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.054 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.054 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.054 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.054 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker_myobj", 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.055 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.056 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.057 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.058 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.059 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.060 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.061 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.062 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.062 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.062 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.062 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.063 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.063 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.063 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.063 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.063 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.066 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.066 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.066 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.066 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.067 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker_myobj", 2020-04-28T12:45:25.067 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.067 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.067 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.067 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.068 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.068 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.068 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.068 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.068 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.069 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.069 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.069 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.069 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.070 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.070 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.070 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.070 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.071 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.071 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.071 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.071 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.072 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.072 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.072 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.072 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.072 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.073 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.073 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.073 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.073 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.074 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.074 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.074 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.074 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.074 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.075 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.075 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.075 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.075 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.076 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.076 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.076 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.077 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.077 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.077 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.077 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.077 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.078 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.079 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.080 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.081 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.082 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.083 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.084 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.085 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.086 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.086 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.086 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.086 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.086 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.087 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.088 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.089 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.090 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.091 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.092 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.093 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.094 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.095 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.095 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.095 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.095 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.096 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.096 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.096 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.096 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.097 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.097 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.097 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.098 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.098 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.098 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.098 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.098 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.099 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.099 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.099 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:45:25.099 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.100 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.101 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.102 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.103 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.103 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.103 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.103 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.104 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.104 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.104 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.104 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.104 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.105 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.106 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.107 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.107 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.107 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.107 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.108 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.109 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.110 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:45:25.110 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.110 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.110 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.110 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.111 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.111 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.111 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.111 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.112 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.113 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.114 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.115 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.116 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.117 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.117 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.117 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.117 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.117 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.118 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.119 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.120 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.121 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.121 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.121 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.121 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.122 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.123 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.124 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.125 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.126 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.127 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.128 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.129 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.130 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.131 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.132 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.133 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.134 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.135 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.136 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj", 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.137 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.138 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.139 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.140 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.141 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.142 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.143 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.144 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj", 2020-04-28T12:45:25.145 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.146 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.147 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.148 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.149 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.150 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.151 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.152 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.153 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.154 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.155 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.156 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.157 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.158 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.159 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.160 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.161 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.162 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.163 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.164 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.165 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.166 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.167 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.168 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.169 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.170 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:45:25.171 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.172 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.173 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.174 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.175 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.176 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.177 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.178 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.179 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.180 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.180 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:45:25.180 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.180 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.180 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.181 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.182 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.183 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.184 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.185 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.186 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.187 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.188 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.189 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.190 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.191 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.192 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.193 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.194 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.195 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.196 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.197 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.198 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.199 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.200 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.200 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.200 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.200 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.201 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.202 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.203 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.204 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.205 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.206 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj_", 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.207 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.208 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.209 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.210 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.211 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.212 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.213 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.214 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj_", 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.215 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.216 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.217 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.218 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.219 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.220 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.221 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.222 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.223 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.224 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.225 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.226 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.227 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.228 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.229 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.229 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.229 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.229 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.230 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.231 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.231 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.231 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.231 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.231 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.232 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.232 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.232 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.232 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.232 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.233 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.234 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.235 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.236 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.237 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.238 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.239 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.240 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:45:25.241 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.242 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.243 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.244 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.245 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.246 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.247 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.248 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.249 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.250 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.251 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.252 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.253 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.254 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.255 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.256 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.257 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": "default-placement.data", 2020-04-28T12:45:25.258 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.259 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "test", 2020-04-28T12:45:25.261 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.261 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.261 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.261 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.261 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": "", 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": "" 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.262 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.263 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.264 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.264 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.264 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.264 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.264 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.265 INFO:tasks.workunit.client.0.smithi092.stdout: "obj": { 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.266 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.267 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.268 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.269 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.270 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.271 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] TestRGWObj.old_to_raw 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.272 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker_myobj", 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.273 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.274 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.275 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker_myobj 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.276 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker_myobj", 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.277 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.278 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.279 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker_myobj 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.280 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.281 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.282 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.283 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns_myobj 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.284 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.285 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.286 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.287 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns_myobj 2020-04-28T12:45:25.288 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.289 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.290 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.291 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__:inst_myobj 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.292 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.293 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.294 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.295 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__:inst_myobj 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.296 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.297 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.298 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.299 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns:inst_myobj 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.300 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.301 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.302 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "myobj", 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.303 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns:inst_myobj 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.304 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj", 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.305 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.306 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.307 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker___myobj 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.308 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj", 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.309 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.310 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.311 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker___myobj 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:45:25.312 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.313 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.314 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.315 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns__myobj 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.316 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.317 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.318 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.319 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns__myobj 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.320 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.321 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.322 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__:inst__myobj 2020-04-28T12:45:25.323 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj" 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.324 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.325 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.326 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__:inst__myobj 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.327 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.328 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.329 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.330 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns:inst__myobj 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.331 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.332 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.333 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj", 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.334 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns:inst__myobj 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.335 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj_", 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.336 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.337 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.338 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker___myobj_ 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker___myobj_", 2020-04-28T12:45:25.339 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.340 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.341 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.342 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker___myobj_ 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.343 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.344 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.345 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.346 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.346 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.346 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.346 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.346 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns__myobj_ 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.347 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.348 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.349 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.350 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "", 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns__myobj_ 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.351 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.352 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.353 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.354 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__:inst__myobj_ 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.355 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "marker__myobj_" 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.356 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.357 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.357 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.357 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.357 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.357 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.358 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "" 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__:inst__myobj_ 2020-04-28T12:45:25.359 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj": { 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.360 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj": { 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.361 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.362 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.363 INFO:tasks.workunit.client.0.smithi092.stdout: "raw_obj2": { 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout: "pool": ".data-pool", 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout: "loc": "" 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout:{ 2020-04-28T12:45:25.364 INFO:tasks.workunit.client.0.smithi092.stdout: "new_obj2": { 2020-04-28T12:45:25.365 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket": { 2020-04-28T12:45:25.365 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "ebtest", 2020-04-28T12:45:25.365 INFO:tasks.workunit.client.0.smithi092.stdout: "marker": "marker", 2020-04-28T12:45:25.365 INFO:tasks.workunit.client.0.smithi092.stdout: "bucket_id": "bucket-id", 2020-04-28T12:45:25.365 INFO:tasks.workunit.client.0.smithi092.stdout: "tenant": "", 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: "explicit_placement": { 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: "data_pool": ".data-pool", 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: "data_extra_pool": "", 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: "index_pool": ".index-pool" 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: }, 2020-04-28T12:45:25.366 INFO:tasks.workunit.client.0.smithi092.stdout: "key": { 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout: "name": "_myobj_", 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout: "instance": "inst", 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout: "ns": "ns" 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout: } 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout:} 2020-04-28T12:45:25.367 INFO:tasks.workunit.client.0.smithi092.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2020-04-28T12:45:25.368 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 4 tests. 2020-04-28T12:45:25.369 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:25.384 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:45:25.384 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:45:25.470 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_throttle.sh on client.0... 2020-04-28T12:45:25.471 INFO:tasks.workunit:Running workunit rgw/test_rgw_throttle.sh... 2020-04-28T12:45:25.471 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:25.506 INFO:teuthology.orchestra.run.smithi092:workunit test rgw/test_rgw_throttle.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh 2020-04-28T12:45:25.584 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:45:25.584 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment set-up. 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 5 tests from Aio_Throttle 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] Aio_Throttle.NoThrottleUpToMax 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] Aio_Throttle.NoThrottleUpToMax (0 ms) 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] Aio_Throttle.CostOverWindow 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] Aio_Throttle.CostOverWindow (0 ms) 2020-04-28T12:45:26.684 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] Aio_Throttle.ThrottleOverMax 2020-04-28T12:45:26.774 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] Aio_Throttle.ThrottleOverMax (90 ms) 2020-04-28T12:45:26.774 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] Aio_Throttle.YieldCostOverWindow 2020-04-28T12:45:26.774 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] Aio_Throttle.YieldCostOverWindow (0 ms) 2020-04-28T12:45:26.774 INFO:tasks.workunit.client.0.smithi092.stdout:[ RUN ] Aio_Throttle.YieldingThrottleOverMax 2020-04-28T12:45:26.862 INFO:tasks.workunit.client.0.smithi092.stdout:[ OK ] Aio_Throttle.YieldingThrottleOverMax (88 ms) 2020-04-28T12:45:26.862 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] 5 tests from Aio_Throttle (178 ms total) 2020-04-28T12:45:26.862 INFO:tasks.workunit.client.0.smithi092.stdout: 2020-04-28T12:45:26.862 INFO:tasks.workunit.client.0.smithi092.stdout:[----------] Global test environment tear-down 2020-04-28T12:45:26.863 INFO:tasks.workunit.client.0.smithi092.stdout:[==========] 5 tests from 1 test suite ran. (1280 ms total) 2020-04-28T12:45:26.863 INFO:tasks.workunit.client.0.smithi092.stdout:[ PASSED ] 5 tests. 2020-04-28T12:45:26.865 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:26.920 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:45:26.920 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:45:26.995 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh'] on client.0... 2020-04-28T12:45:26.995 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.045 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-28T12:45:27.263 DEBUG:teuthology.parallel:result is None 2020-04-28T12:45:27.264 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.277 INFO:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:45:27.344 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:45:27.344 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.397 INFO:teuthology.orchestra.run.smithi092:> rmdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:45:27.451 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:45:27.451 INFO:teuthology.run_tasks:Running task ragweed... 2020-04-28T12:45:27.465 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2020-04-28T12:45:27.465 INFO:tasks.ragweed:Downloading ragweed... 2020-04-28T12:45:27.465 INFO:tasks.ragweed:Using branch 'octopus' for ragweed 2020-04-28T12:45:27.466 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.504 INFO:teuthology.orchestra.run.smithi092:> git clone -b octopus git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:45:27.557 INFO:teuthology.orchestra.run.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:45:27.568 INFO:teuthology.orchestra.run.smithi092.stderr:fatal: Remote branch octopus not found in upstream origin 2020-04-28T12:45:27.569 DEBUG:teuthology.orchestra.run:got remote process result: 128 2020-04-28T12:45:27.569 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.622 INFO:teuthology.orchestra.run.smithi092:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:45:27.677 INFO:teuthology.orchestra.run.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:45:27.824 INFO:tasks.ragweed:Creating rgw users... 2020-04-28T12:45:27.824 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2020-04-28T12:45:27.824 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:27.877 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key WRZVFGGPGVUAEODUVRMW --secret HUoNcvb+kPg34Sg6bsXA4ASBwMFNvDOD7jmT5PCjk0j6qNEmyIBWig== --email sysuser.client.0+test@test.test --system true 2020-04-28T12:45:27.965 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.960+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.967 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.962+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.962+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.968 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.963+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.963+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.964+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:27.969 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.964+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.968+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:27.996 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:45:27.996 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:45:27.997 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:45:27.997 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:45:27.997 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.997 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:27.997 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.991+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.998 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:45:27.998 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.998 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.992+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.993+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.993+0000 7fba44591180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.993+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:27.999 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.993+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.000 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.993+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:45:28.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 zonegroup default 2020-04-28T12:45:28.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 10 Cannot find current period zone using local zone 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.994+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:45:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 zone default found 2020-04-28T12:45:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.995+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.996+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.996+0000 7fba44591180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.996+0000 7fba44591180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.996+0000 7fba44591180 20 started sync module instance, tier type = 2020-04-28T12:45:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.996+0000 7fba44591180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:45:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:27.999+0000 7fba3257a700 0 -- 172.21.15.92:0/1404086628 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7fba2803e5d0 msgr2=0x7fba2803e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=0 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=1 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=2 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=3 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=4 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=5 2020-04-28T12:45:28.015 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.009+0000 7fba44591180 20 add_watcher() i=6 2020-04-28T12:45:28.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.011+0000 7fba44591180 20 add_watcher() i=7 2020-04-28T12:45:28.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.011+0000 7fba44591180 2 all 8 watchers are set, enabling cache 2020-04-28T12:45:28.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.011+0000 7fba44591180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:45:28.016 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.011+0000 7fba44591180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:45:28.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.011+0000 7fba02fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:45:28.017 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.012+0000 7fba32d7b700 0 -- 172.21.15.92:0/920126143 >> v1:172.21.15.138:6789/0 conn(0x564388f79410 legacy=0x564388f7a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:45:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fb9717fa700 20 reqs_thread_entry: start 2020-04-28T12:45:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fb96affd700 20 reqs_thread_entry: start 2020-04-28T12:45:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 20 init_complete bucket index max shards: 1999 2020-04-28T12:45:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fb9697fa700 20 reqs_thread_entry: start 2020-04-28T12:45:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 20 get_system_obj_state: rctx=0x7ffeb40dc178 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x564388e23170 s->prefetch_data=0 2020-04-28T12:45:28.072 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:45:28.072 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2020-04-28T12:45:28.072 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:45:28.072 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.065+0000 7fba44591180 20 get_system_obj_state: rctx=0x7ffeb40dc188 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x564388e23170 s->prefetch_data=0 2020-04-28T12:45:28.072 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2020-04-28T12:45:28.073 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2020-04-28T12:45:28.073 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 20 get_system_obj_state: rctx=0x7ffeb40dc188 obj=default.rgw.meta:users.keys:WRZVFGGPGVUAEODUVRMW state=0x564388e23170 s->prefetch_data=0 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 cache get: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW : miss 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW info.flags=0x0 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 adding default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW to cache LRU end 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 20 get_system_obj_state: rctx=0x7ffeb40dbb98 obj=default.rgw.meta:users.keys:WRZVFGGPGVUAEODUVRMW state=0x564388e23170 s->prefetch_data=0 2020-04-28T12:45:28.074 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.066+0000 7fba44591180 10 cache get: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW : type miss (requested=0x6, cached=0x0) 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW info.flags=0x0 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 10 moving default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW to cache LRU end 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 20 get_system_obj_state: rctx=0x7ffeb40dbe88 obj=default.rgw.meta:users.keys:WRZVFGGPGVUAEODUVRMW state=0x564388e23170 s->prefetch_data=0 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 10 cache get: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW : type miss (requested=0x6, cached=0x0) 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW info.flags=0x0 2020-04-28T12:45:28.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.067+0000 7fba44591180 10 moving default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW to cache LRU end 2020-04-28T12:45:28.077 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba44591180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba44591180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba137fe700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94848060663264 notifier 4499 bl.length()=637 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba137fe700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.069+0000 7fba137fe700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:45:28.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.071+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:45:28.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.071+0000 7fba44591180 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.071+0000 7fba44591180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2020-04-28T12:45:28.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.072+0000 7fba137fe700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94848060666720 notifier 4499 bl.length()=202 2020-04-28T12:45:28.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.072+0000 7fba137fe700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:45:28.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.072+0000 7fba137fe700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.080 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba44591180 10 cache put: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW info.flags=0x7 2020-04-28T12:45:28.080 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba44591180 10 moving default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW to cache LRU end 2020-04-28T12:45:28.080 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba44591180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2020-04-28T12:45:28.080 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba137fe700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94848060671424 notifier 4499 bl.length()=190 2020-04-28T12:45:28.080 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba137fe700 10 cache put: name=default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW info.flags=0x7 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.074+0000 7fba137fe700 10 moving default.rgw.meta+users.keys+WRZVFGGPGVUAEODUVRMW to cache LRU end 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stdout: "user_id": "sysuser.client.0", 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stdout: "display_name": "Mr. sysuser.client.0", 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stdout: "email": "sysuser.client.0+test@test.test", 2020-04-28T12:45:28.081 INFO:teuthology.orchestra.run.smithi092.stdout: "suspended": 0, 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max_buckets": 1000, 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: "subusers": [], 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: "keys": [ 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: { 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: "user": "sysuser.client.0", 2020-04-28T12:45:28.082 INFO:teuthology.orchestra.run.smithi092.stdout: "access_key": "WRZVFGGPGVUAEODUVRMW", 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: "secret_key": "HUoNcvb+kPg34Sg6bsXA4ASBwMFNvDOD7jmT5PCjk0j6qNEmyIBWig==" 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: } 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: "swift_keys": [], 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": [], 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: "op_mask": "read, write, delete", 2020-04-28T12:45:28.083 INFO:teuthology.orchestra.run.smithi092.stdout: "system": "true", 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_placement": "", 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_storage_class": "", 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "placement_tags": [], 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "bucket_quota": { 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:45:28.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "user_quota": { 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:45:28.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: "temp_url_keys": [], 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "rgw", 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: "mfa_ids": [] 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout:} 2020-04-28T12:45:28.086 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:28.087 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.075+0000 7fba02fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:45:28.087 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.077+0000 7fba44591180 20 remove_watcher() i=0 2020-04-28T12:45:28.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.077+0000 7fba44591180 2 removed watcher, disabling cache 2020-04-28T12:45:28.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.078+0000 7fba44591180 20 remove_watcher() i=1 2020-04-28T12:45:28.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.079+0000 7fba44591180 20 remove_watcher() i=2 2020-04-28T12:45:28.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.081+0000 7fba44591180 20 remove_watcher() i=3 2020-04-28T12:45:28.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.082+0000 7fba44591180 20 remove_watcher() i=4 2020-04-28T12:45:28.089 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.083+0000 7fba44591180 20 remove_watcher() i=5 2020-04-28T12:45:28.090 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.085+0000 7fba44591180 20 remove_watcher() i=6 2020-04-28T12:45:28.091 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.086+0000 7fba44591180 20 remove_watcher() i=7 2020-04-28T12:45:28.095 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2020-04-28T12:45:28.096 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:28.109 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key MRTSTFLXLMMLKLSIFBFU --secret NRu5CecLPfzan35usUtcEEylJsBNM/34QT5BhutVrT3yCVoE42SQ7Q== --email ragweed.client.0+test@test.test --system false 2020-04-28T12:45:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.198+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.201+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.201+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.202+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.202+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.202+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.202+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.203+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.213+0000 7faa05c1b700 0 -- 172.21.15.92:0/2147845666 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x560586a2a770 msgr2=0x560586a2abb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.217+0000 7faa17c32180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.217+0000 7faa17c32180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.217+0000 7faa17c32180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.217+0000 7faa17c32180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.217+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.218+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.218+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.218+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.218+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa05c1b700 0 -- 172.21.15.92:0/2147845666 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7fa9e80025d0 msgr2=0x7faa000030b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:45:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.219+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 zonegroup default 2020-04-28T12:45:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.220+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.221+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.221+0000 7faa17c32180 10 Cannot find current period zone using local zone 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.221+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.221+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.221+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:45:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:45:28.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 zone default found 2020-04-28T12:45:28.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.222+0000 7faa17c32180 20 rados->read ofs=0 len=0 2020-04-28T12:45:28.231 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.223+0000 7faa17c32180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:45:28.231 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.223+0000 7faa17c32180 20 started sync module instance, tier type = 2020-04-28T12:45:28.231 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.223+0000 7faa17c32180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:45:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=0 2020-04-28T12:45:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=1 2020-04-28T12:45:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=2 2020-04-28T12:45:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=3 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=4 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=5 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.234+0000 7faa17c32180 20 add_watcher() i=6 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.235+0000 7faa17c32180 20 add_watcher() i=7 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.235+0000 7faa17c32180 2 all 8 watchers are set, enabling cache 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.235+0000 7faa17c32180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.235+0000 7faa17c32180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:45:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.236+0000 7fa9d67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:45:28.296 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7fa94cff9700 20 reqs_thread_entry: start 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7fa9467fc700 20 reqs_thread_entry: start 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7faa17c32180 20 init_complete bucket index max shards: 1999 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7fa944ff9700 20 reqs_thread_entry: start 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7faa17c32180 20 get_system_obj_state: rctx=0x7fffbefa80e8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5605868fe170 s->prefetch_data=0 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.287+0000 7faa17c32180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:45:28.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 20 get_system_obj_state: rctx=0x7fffbefa80f8 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x5605868fe170 s->prefetch_data=0 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 20 get_system_obj_state: rctx=0x7fffbefa80f8 obj=default.rgw.meta:users.keys:MRTSTFLXLMMLKLSIFBFU state=0x5605868fe170 s->prefetch_data=0 2020-04-28T12:45:28.298 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache get: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU : miss 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU info.flags=0x0 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 adding default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU to cache LRU end 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 20 get_system_obj_state: rctx=0x7fffbefa7b08 obj=default.rgw.meta:users.keys:MRTSTFLXLMMLKLSIFBFU state=0x5605868fe170 s->prefetch_data=0 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.288+0000 7faa17c32180 10 cache get: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU : type miss (requested=0x6, cached=0x0) 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU info.flags=0x0 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 10 moving default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU to cache LRU end 2020-04-28T12:45:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 20 get_system_obj_state: rctx=0x7fffbefa7df8 obj=default.rgw.meta:users.keys:MRTSTFLXLMMLKLSIFBFU state=0x5605868fe170 s->prefetch_data=0 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 10 cache get: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU : type miss (requested=0x6, cached=0x0) 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU info.flags=0x0 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.289+0000 7faa17c32180 10 moving default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU to cache LRU end 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7faa17c32180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7faa17c32180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2020-04-28T12:45:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7fa9e6ffd700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94581733699824 notifier 4881 bl.length()=637 2020-04-28T12:45:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7fa9e6ffd700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:45:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.291+0000 7fa9e6ffd700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:45:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.293+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:45:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.293+0000 7faa17c32180 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.293+0000 7faa17c32180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2020-04-28T12:45:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.294+0000 7fa9e6ffd700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94581733694928 notifier 4881 bl.length()=202 2020-04-28T12:45:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.294+0000 7fa9e6ffd700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.294+0000 7fa9e6ffd700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7faa17c32180 10 cache put: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU info.flags=0x7 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7faa17c32180 10 moving default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU to cache LRU end 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7faa17c32180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7fa9e6ffd700 10 RGWWatcher::handle_notify() notify_id 506806140930 cookie 94581733699824 notifier 4881 bl.length()=190 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7fa9e6ffd700 10 cache put: name=default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU info.flags=0x7 2020-04-28T12:45:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.296+0000 7fa9e6ffd700 10 moving default.rgw.meta+users.keys+MRTSTFLXLMMLKLSIFBFU to cache LRU end 2020-04-28T12:45:28.304 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2020-04-28T12:45:28.304 INFO:teuthology.orchestra.run.smithi092.stdout: "user_id": "ragweed.client.0", 2020-04-28T12:45:28.304 INFO:teuthology.orchestra.run.smithi092.stdout: "display_name": "Mr. ragweed.client.0", 2020-04-28T12:45:28.304 INFO:teuthology.orchestra.run.smithi092.stdout: "email": "ragweed.client.0+test@test.test", 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "suspended": 0, 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "max_buckets": 1000, 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "subusers": [], 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "keys": [ 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: { 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "user": "ragweed.client.0", 2020-04-28T12:45:28.305 INFO:teuthology.orchestra.run.smithi092.stdout: "access_key": "MRTSTFLXLMMLKLSIFBFU", 2020-04-28T12:45:28.306 INFO:teuthology.orchestra.run.smithi092.stdout: "secret_key": "NRu5CecLPfzan35usUtcEEylJsBNM/34QT5BhutVrT3yCVoE42SQ7Q==" 2020-04-28T12:45:28.306 INFO:teuthology.orchestra.run.smithi092.stdout: } 2020-04-28T12:45:28.306 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2020-04-28T12:45:28.306 INFO:teuthology.orchestra.run.smithi092.stdout: "swift_keys": [], 2020-04-28T12:45:28.306 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": [], 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "op_mask": "read, write, delete", 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_placement": "", 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_storage_class": "", 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "placement_tags": [], 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bucket_quota": { 2020-04-28T12:45:28.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "user_quota": { 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:45:28.310 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "temp_url_keys": [], 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "rgw", 2020-04-28T12:45:28.311 INFO:teuthology.orchestra.run.smithi092.stdout: "mfa_ids": [] 2020-04-28T12:45:28.312 INFO:teuthology.orchestra.run.smithi092.stdout:} 2020-04-28T12:45:28.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:28.312 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.297+0000 7fa9d67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:45:28.312 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.298+0000 7faa17c32180 20 remove_watcher() i=0 2020-04-28T12:45:28.312 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.298+0000 7faa17c32180 2 removed watcher, disabling cache 2020-04-28T12:45:28.313 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.300+0000 7faa17c32180 20 remove_watcher() i=1 2020-04-28T12:45:28.313 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.301+0000 7faa17c32180 20 remove_watcher() i=2 2020-04-28T12:45:28.313 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.302+0000 7faa17c32180 20 remove_watcher() i=3 2020-04-28T12:45:28.314 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.303+0000 7faa17c32180 20 remove_watcher() i=4 2020-04-28T12:45:28.314 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.305+0000 7faa17c32180 20 remove_watcher() i=5 2020-04-28T12:45:28.314 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.306+0000 7faa17c32180 20 remove_watcher() i=6 2020-04-28T12:45:28.314 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:45:28.307+0000 7faa17c32180 20 remove_watcher() i=7 2020-04-28T12:45:28.316 INFO:tasks.ragweed:Configuring ragweed... 2020-04-28T12:45:28.316 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:28.329 INFO:teuthology.orchestra.run.smithi092:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2020-04-28T12:45:31.368 INFO:teuthology.orchestra.run.smithi092.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2020-04-28T12:45:31.769 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:07:32 ago on Tue 28 Apr 2020 12:37:59 PM UTC. 2020-04-28T12:45:32.015 INFO:teuthology.orchestra.run.smithi092.stdout:Package python36-devel-3.6.8-2.module_el8.1.0+245+c39af44f.x86_64 is already installed. 2020-04-28T12:45:32.122 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2020-04-28T12:45:32.123 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:45:32.123 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2020-04-28T12:45:32.124 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:45:32.124 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2020-04-28T12:45:32.124 INFO:teuthology.orchestra.run.smithi092.stdout: libevent-devel x86_64 2.1.8-5.el8 CentOS-AppStream 104 k 2020-04-28T12:45:32.124 INFO:teuthology.orchestra.run.smithi092.stdout: libxml2-devel x86_64 2.9.7-5.el8 CentOS-AppStream 1.0 M 2020-04-28T12:45:32.124 INFO:teuthology.orchestra.run.smithi092.stdout: libxslt-devel x86_64 1.1.32-3.el8 CentOS-AppStream 322 k 2020-04-28T12:45:32.125 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-10.el8 CentOS-Base 56 k 2020-04-28T12:45:32.125 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2020-04-28T12:45:32.125 INFO:teuthology.orchestra.run.smithi092.stdout: cmake-filesystem x86_64 3.11.4-3.el8 CentOS-AppStream 40 k 2020-04-28T12:45:32.125 INFO:teuthology.orchestra.run.smithi092.stdout: libgcrypt-devel x86_64 1.8.3-4.el8 CentOS-Base 149 k 2020-04-28T12:45:32.126 INFO:teuthology.orchestra.run.smithi092.stdout: libgpg-error-devel x86_64 1.31-1.el8 CentOS-Base 64 k 2020-04-28T12:45:32.126 INFO:teuthology.orchestra.run.smithi092.stdout: xz-devel x86_64 5.2.4-3.el8 CentOS-Base 62 k 2020-04-28T12:45:32.126 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:32.126 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2020-04-28T12:45:32.127 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2020-04-28T12:45:32.127 INFO:teuthology.orchestra.run.smithi092.stdout:Install 8 Packages 2020-04-28T12:45:32.127 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:32.128 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 1.8 M 2020-04-28T12:45:32.128 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 12 M 2020-04-28T12:45:32.128 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2020-04-28T12:45:32.156 INFO:teuthology.orchestra.run.smithi092.stdout:(1/8): cmake-filesystem-3.11.4-3.el8.x86_64.rpm 1.3 MB/s | 40 kB 00:00 2020-04-28T12:45:32.163 INFO:teuthology.orchestra.run.smithi092.stdout:(2/8): libxslt-devel-1.1.32-3.el8.x86_64.rpm 43 MB/s | 322 kB 00:00 2020-04-28T12:45:32.164 INFO:teuthology.orchestra.run.smithi092.stdout:(3/8): libevent-devel-2.1.8-5.el8.x86_64.rpm 2.7 MB/s | 104 kB 00:00 2020-04-28T12:45:32.167 INFO:teuthology.orchestra.run.smithi092.stdout:(4/8): libgpg-error-devel-1.31-1.el8.x86_64.rpm 20 MB/s | 64 kB 00:00 2020-04-28T12:45:32.168 INFO:teuthology.orchestra.run.smithi092.stdout:(5/8): libgcrypt-devel-1.8.3-4.el8.x86_64.rpm 32 MB/s | 149 kB 00:00 2020-04-28T12:45:32.170 INFO:teuthology.orchestra.run.smithi092.stdout:(6/8): xz-devel-5.2.4-3.el8.x86_64.rpm 23 MB/s | 62 kB 00:00 2020-04-28T12:45:32.170 INFO:teuthology.orchestra.run.smithi092.stdout:(7/8): zlib-devel-1.2.11-10.el8.x86_64.rpm 24 MB/s | 56 kB 00:00 2020-04-28T12:45:32.179 INFO:teuthology.orchestra.run.smithi092.stdout:(8/8): libxml2-devel-2.9.7-5.el8.x86_64.rpm 19 MB/s | 1.0 MB 00:00 2020-04-28T12:45:32.181 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:45:32.181 INFO:teuthology.orchestra.run.smithi092.stdout:Total 32 MB/s | 1.8 MB 00:00 2020-04-28T12:45:32.190 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2020-04-28T12:45:32.201 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2020-04-28T12:45:32.202 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2020-04-28T12:45:32.341 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2020-04-28T12:45:32.341 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2020-04-28T12:45:32.662 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2020-04-28T12:45:32.848 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:45:32.872 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:45:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:45:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:45:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 3/8 2020-04-28T12:45:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xz-devel-5.2.4-3.el8.x86_64 4/8 2020-04-28T12:45:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cmake-filesystem-3.11.4-3.el8.x86_64 5/8 2020-04-28T12:45:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libxml2-devel-2.9.7-5.el8.x86_64 6/8 2020-04-28T12:45:34.383 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libxslt-devel-1.1.32-3.el8.x86_64 7/8 2020-04-28T12:45:34.587 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:45:34.810 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:45:34.810 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cmake-filesystem-3.11.4-3.el8.x86_64 1/8 2020-04-28T12:45:34.810 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libevent-devel-2.1.8-5.el8.x86_64 2/8 2020-04-28T12:45:34.810 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libxml2-devel-2.9.7-5.el8.x86_64 3/8 2020-04-28T12:45:34.810 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libxslt-devel-1.1.32-3.el8.x86_64 4/8 2020-04-28T12:45:34.811 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgcrypt-devel-1.8.3-4.el8.x86_64 5/8 2020-04-28T12:45:34.811 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgpg-error-devel-1.31-1.el8.x86_64 6/8 2020-04-28T12:45:34.811 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xz-devel-5.2.4-3.el8.x86_64 7/8 2020-04-28T12:45:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 8/8 2020-04-28T12:45:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:35.204 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2020-04-28T12:45:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: libevent-devel-2.1.8-5.el8.x86_64 libxml2-devel-2.9.7-5.el8.x86_64 2020-04-28T12:45:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: libxslt-devel-1.1.32-3.el8.x86_64 zlib-devel-1.2.11-10.el8.x86_64 2020-04-28T12:45:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: cmake-filesystem-3.11.4-3.el8.x86_64 libgcrypt-devel-1.8.3-4.el8.x86_64 2020-04-28T12:45:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: libgpg-error-devel-1.31-1.el8.x86_64 xz-devel-5.2.4-3.el8.x86_64 2020-04-28T12:45:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:35.211 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2020-04-28T12:45:36.236 INFO:teuthology.orchestra.run.smithi092.stdout:Using base prefix '/usr' 2020-04-28T12:45:36.237 INFO:teuthology.orchestra.run.smithi092.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python3 2020-04-28T12:45:36.237 INFO:teuthology.orchestra.run.smithi092.stdout:Also creating executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2020-04-28T12:45:38.906 INFO:teuthology.orchestra.run.smithi092.stdout:Installing setuptools, pip, wheel...done. 2020-04-28T12:45:38.916 INFO:teuthology.orchestra.run.smithi092.stdout:Running virtualenv with interpreter /usr/bin/python3 2020-04-28T12:45:39.454 INFO:teuthology.orchestra.run.smithi092.stdout:Requirement already up-to-date: pip in ./virtualenv/lib/python3.6/site-packages (20.0.2) 2020-04-28T12:45:40.222 INFO:teuthology.orchestra.run.smithi092.stdout:Requirement already satisfied: six in /usr/lib/python3.6/site-packages (1.11.0) 2020-04-28T12:45:40.864 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting nose 2020-04-28T12:45:40.907 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2020-04-28T12:45:41.072 INFO:teuthology.orchestra.run.smithi092.stdout:Installing collected packages: nose 2020-04-28T12:45:41.154 INFO:teuthology.orchestra.run.smithi092.stdout:Successfully installed nose-1.3.7 2020-04-28T12:45:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:Requirement already satisfied: setuptools in ./virtualenv/lib/python3.6/site-packages (46.1.3) 2020-04-28T12:45:42.358 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting PyYAML 2020-04-28T12:45:42.401 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading PyYAML-5.3.1.tar.gz (269 kB) 2020-04-28T12:45:42.926 INFO:teuthology.orchestra.run.smithi092.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2020-04-28T12:45:43.032 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting boto!=2.46.0,>=2.6.0 2020-04-28T12:45:43.040 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2020-04-28T12:45:43.328 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting munch>=1.0.0 2020-04-28T12:45:43.337 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading munch-2.5.0-py2.py3-none-any.whl (10 kB) 2020-04-28T12:45:43.628 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting gevent>=1.0 2020-04-28T12:45:43.637 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading gevent-20.4.0-cp36-cp36m-manylinux2010_x86_64.whl (5.1 MB) 2020-04-28T12:45:44.344 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting httplib2 2020-04-28T12:45:44.353 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading httplib2-0.17.3-py3-none-any.whl (95 kB) 2020-04-28T12:45:45.200 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting lxml 2020-04-28T12:45:45.209 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading lxml-4.5.0-cp36-cp36m-manylinux1_x86_64.whl (5.8 MB) 2020-04-28T12:45:45.559 INFO:teuthology.orchestra.run.smithi092.stdout:Requirement already satisfied, skipping upgrade: six in /usr/lib/python3.6/site-packages (from munch>=1.0.0->-r requirements.txt (line 4)) (1.11.0) 2020-04-28T12:45:45.687 INFO:teuthology.orchestra.run.smithi092.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2020-04-28T12:45:45.696 INFO:teuthology.orchestra.run.smithi092.stdout: Downloading greenlet-0.4.15-cp36-cp36m-manylinux1_x86_64.whl (41 kB) 2020-04-28T12:45:45.755 INFO:teuthology.orchestra.run.smithi092.stdout:Building wheels for collected packages: PyYAML 2020-04-28T12:45:45.756 INFO:teuthology.orchestra.run.smithi092.stdout: Building wheel for PyYAML (setup.py): started 2020-04-28T12:45:46.235 INFO:teuthology.orchestra.run.smithi092.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2020-04-28T12:45:46.235 INFO:teuthology.orchestra.run.smithi092.stdout: Created wheel for PyYAML: filename=PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl size=44621 sha256=2c584b0c249a4d7d78d265ba3a35208374f3019ea11613532a7c46c2972a8a5a 2020-04-28T12:45:46.235 INFO:teuthology.orchestra.run.smithi092.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/e5/9d/ad/2ee53cf262cba1ffd8afe1487eef788ea3f260b7e6232a80fc 2020-04-28T12:45:46.236 INFO:teuthology.orchestra.run.smithi092.stdout:Successfully built PyYAML 2020-04-28T12:45:46.418 INFO:teuthology.orchestra.run.smithi092.stdout:Installing collected packages: PyYAML, boto, munch, greenlet, gevent, httplib2, lxml 2020-04-28T12:45:46.418 INFO:teuthology.orchestra.run.smithi092.stdout: Attempting uninstall: PyYAML 2020-04-28T12:45:46.419 INFO:teuthology.orchestra.run.smithi092.stdout: Found existing installation: PyYAML 3.12 2020-04-28T12:45:46.419 INFO:teuthology.orchestra.run.smithi092.stdout: Not uninstalling pyyaml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:45:46.420 INFO:teuthology.orchestra.run.smithi092.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2020-04-28T12:45:47.470 INFO:teuthology.orchestra.run.smithi092.stdout: Attempting uninstall: lxml 2020-04-28T12:45:47.471 INFO:teuthology.orchestra.run.smithi092.stdout: Found existing installation: lxml 4.2.3 2020-04-28T12:45:47.471 INFO:teuthology.orchestra.run.smithi092.stdout: Not uninstalling lxml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:45:47.471 INFO:teuthology.orchestra.run.smithi092.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2020-04-28T12:45:47.644 INFO:teuthology.orchestra.run.smithi092.stdout:Successfully installed PyYAML-5.3.1 boto-2.49.0 gevent-20.4.0 greenlet-0.4.15 httplib2-0.17.3 lxml-4.5.0 munch-2.5.0 2020-04-28T12:45:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:running develop 2020-04-28T12:45:48.013 INFO:teuthology.orchestra.run.smithi092.stdout:running egg_info 2020-04-28T12:45:48.013 INFO:teuthology.orchestra.run.smithi092.stdout:creating ragweed.egg-info 2020-04-28T12:45:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:writing ragweed.egg-info/PKG-INFO 2020-04-28T12:45:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2020-04-28T12:45:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:writing requirements to ragweed.egg-info/requires.txt 2020-04-28T12:45:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2020-04-28T12:45:48.014 INFO:teuthology.orchestra.run.smithi092.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:45:48.025 INFO:teuthology.orchestra.run.smithi092.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:45:48.025 INFO:teuthology.orchestra.run.smithi092.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:45:48.027 INFO:teuthology.orchestra.run.smithi092.stdout:running build_ext 2020-04-28T12:45:48.027 INFO:teuthology.orchestra.run.smithi092.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/ragweed.egg-link (link to .) 2020-04-28T12:45:48.027 INFO:teuthology.orchestra.run.smithi092.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2020-04-28T12:45:48.028 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.028 INFO:teuthology.orchestra.run.smithi092.stdout:Installed /home/ubuntu/cephtest/ragweed 2020-04-28T12:45:48.029 INFO:teuthology.orchestra.run.smithi092.stdout:Processing dependencies for ragweed==0.0.1 2020-04-28T12:45:48.031 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for isodate>=0.4.4 2020-04-28T12:45:48.031 INFO:teuthology.orchestra.run.smithi092.stdout:Reading https://pypi.org/simple/isodate/ 2020-04-28T12:45:48.080 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl#sha256=aa4d33c06640f5352aca96e4b81afd8ab3b47337cc12089822d6f322ac772c81 2020-04-28T12:45:48.138 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: isodate 0.6.0 2020-04-28T12:45:48.138 INFO:teuthology.orchestra.run.smithi092.stdout:Processing isodate-0.6.0-py2.py3-none-any.whl 2020-04-28T12:45:48.138 INFO:teuthology.orchestra.run.smithi092.stdout:Installing isodate-0.6.0-py2.py3-none-any.whl to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.146 INFO:teuthology.orchestra.run.smithi092.stdout:Adding isodate 0.6.0 to easy-install.pth file 2020-04-28T12:45:48.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/isodate-0.6.0-py3.6.egg 2020-04-28T12:45:48.198 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for gevent==20.4.0 2020-04-28T12:45:48.199 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: gevent 20.4.0 2020-04-28T12:45:48.199 INFO:teuthology.orchestra.run.smithi092.stdout:Adding gevent 20.4.0 to easy-install.pth file 2020-04-28T12:45:48.199 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.199 INFO:teuthology.orchestra.run.smithi092.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.201 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for munch==2.5.0 2020-04-28T12:45:48.201 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: munch 2.5.0 2020-04-28T12:45:48.201 INFO:teuthology.orchestra.run.smithi092.stdout:Adding munch 2.5.0 to easy-install.pth file 2020-04-28T12:45:48.202 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.202 INFO:teuthology.orchestra.run.smithi092.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.202 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for PyYAML==5.3.1 2020-04-28T12:45:48.202 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: PyYAML 5.3.1 2020-04-28T12:45:48.202 INFO:teuthology.orchestra.run.smithi092.stdout:Adding PyYAML 5.3.1 to easy-install.pth file 2020-04-28T12:45:48.203 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.203 INFO:teuthology.orchestra.run.smithi092.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.203 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for boto==2.49.0 2020-04-28T12:45:48.203 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: boto 2.49.0 2020-04-28T12:45:48.204 INFO:teuthology.orchestra.run.smithi092.stdout:Adding boto 2.49.0 to easy-install.pth file 2020-04-28T12:45:48.204 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.204 INFO:teuthology.orchestra.run.smithi092.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for six==1.11.0 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: six 1.11.0 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Adding six 1.11.0 to easy-install.pth file 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Using /usr/lib/python3.6/site-packages 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Searching for greenlet==0.4.15 2020-04-28T12:45:48.205 INFO:teuthology.orchestra.run.smithi092.stdout:Best match: greenlet 0.4.15 2020-04-28T12:45:48.206 INFO:teuthology.orchestra.run.smithi092.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2020-04-28T12:45:48.206 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:45:48.206 INFO:teuthology.orchestra.run.smithi092.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:45:48.206 INFO:teuthology.orchestra.run.smithi092.stdout:Finished processing dependencies for ragweed==0.0.1 2020-04-28T12:45:48.223 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:48.236 INFO:teuthology.orchestra.run.smithi092:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2020-04-28T12:45:48.321 INFO:tasks.ragweed:Configuring boto... 2020-04-28T12:45:48.322 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:48.375 INFO:teuthology.orchestra.run.smithi092:> cat > /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:45:48.460 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:45:48.513 INFO:teuthology.orchestra.run.smithi092:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2020-04-28T12:45:52.495 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2020-04-28T12:45:53.657 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2020-04-28T12:45:54.687 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2020-04-28T12:45:55.673 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2020-04-28T12:46:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2020-04-28T12:46:02.760 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2020-04-28T12:46:04.955 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2020-04-28T12:46:07.964 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2020-04-28T12:46:09.955 INFO:teuthology.orchestra.run.smithi092.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2020-04-28T12:46:09.956 INFO:teuthology.orchestra.run.smithi092.stderr: 2020-04-28T12:46:09.956 INFO:teuthology.orchestra.run.smithi092.stderr:---------------------------------------------------------------------- 2020-04-28T12:46:09.956 INFO:teuthology.orchestra.run.smithi092.stderr:Ran 9 tests in 21.150s 2020-04-28T12:46:09.956 INFO:teuthology.orchestra.run.smithi092.stderr: 2020-04-28T12:46:09.957 INFO:teuthology.orchestra.run.smithi092.stderr:OK 2020-04-28T12:46:09.977 INFO:tasks.ragweed:Cleaning up boto... 2020-04-28T12:46:09.978 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:09.992 INFO:teuthology.orchestra.run.smithi092:> rm /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:46:10.046 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:10.099 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2020-04-28T12:46:10.181 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.177+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.183 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.179+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.183 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.179+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.180+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.180+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.180+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.180+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.181+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.195+0000 7f6137bfd180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:46:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.195+0000 7f6137bfd180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:46:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.195+0000 7f6137bfd180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:46:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.195+0000 7f6137bfd180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:46:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.195+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.196+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.196+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.196+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.196+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.197+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.197+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.197+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:10.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.197+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.198+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 zonegroup default 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 10 Cannot find current period zone using local zone 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.199+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.200+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.200+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.200+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.200+0000 7f6137bfd180 20 zone default found 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.200+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.201+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.201+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.201+0000 7f6137bfd180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.201+0000 7f6137bfd180 20 started sync module instance, tier type = 2020-04-28T12:46:10.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.201+0000 7f6137bfd180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:46:10.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.204+0000 7f6125be6700 0 -- 172.21.15.92:0/2633130312 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f611c005760 msgr2=0x7f611c004160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:10.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=0 2020-04-28T12:46:10.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=1 2020-04-28T12:46:10.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=2 2020-04-28T12:46:10.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=3 2020-04-28T12:46:10.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=4 2020-04-28T12:46:10.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=5 2020-04-28T12:46:10.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.213+0000 7f6137bfd180 20 add_watcher() i=6 2020-04-28T12:46:10.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.214+0000 7f6137bfd180 20 add_watcher() i=7 2020-04-28T12:46:10.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.214+0000 7f6137bfd180 2 all 8 watchers are set, enabling cache 2020-04-28T12:46:10.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.214+0000 7f6137bfd180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:46:10.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.214+0000 7f6137bfd180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:46:10.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.215+0000 7f60f67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:10.220 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.215+0000 7f61253e5700 0 -- 172.21.15.92:0/3774947857 >> v1:172.21.15.138:6789/0 conn(0x562e71655dd0 legacy=0x562e716581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f606cff9700 20 reqs_thread_entry: start 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f6137bfd180 20 init_complete bucket index max shards: 1999 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f60667fc700 20 reqs_thread_entry: start 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f6064ff9700 20 reqs_thread_entry: start 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f6137bfd180 20 get_system_obj_state: rctx=0x7ffcaa1657b8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x562e714f9170 s->prefetch_data=0 2020-04-28T12:46:10.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.267+0000 7f6137bfd180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:46:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2020-04-28T12:46:10.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.268+0000 7f6137bfd180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6137bfd180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6137bfd180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2020-04-28T12:46:10.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6137bfd180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:46:10.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6137bfd180 10 removing key index: WRZVFGGPGVUAEODUVRMW 2020-04-28T12:46:10.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6137bfd180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2020-04-28T12:46:10.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.269+0000 7f6106ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94757470872048 notifier 4520 bl.length()=170 2020-04-28T12:46:10.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.271+0000 7f6137bfd180 10 removing email index: sysuser.client.0+test@test.test 2020-04-28T12:46:10.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.271+0000 7f6137bfd180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2020-04-28T12:46:10.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.272+0000 7f6106ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94757470867568 notifier 4520 bl.length()=182 2020-04-28T12:46:10.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.274+0000 7f6137bfd180 10 removing user buckets index 2020-04-28T12:46:10.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.274+0000 7f6137bfd180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2020-04-28T12:46:10.279 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.274+0000 7f6106ffd700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94757470865680 notifier 4520 bl.length()=173 2020-04-28T12:46:10.280 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.276+0000 7f6137bfd180 10 removing user index: sysuser.client.0 2020-04-28T12:46:10.280 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.276+0000 7f6137bfd180 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2020-04-28T12:46:10.280 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.276+0000 7f6137bfd180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2020-04-28T12:46:10.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.276+0000 7f6106ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94757470863680 notifier 4520 bl.length()=165 2020-04-28T12:46:10.283 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.279+0000 7f60f67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:10.284 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.280+0000 7f6137bfd180 20 remove_watcher() i=0 2020-04-28T12:46:10.284 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.280+0000 7f6137bfd180 2 removed watcher, disabling cache 2020-04-28T12:46:10.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.281+0000 7f6137bfd180 20 remove_watcher() i=1 2020-04-28T12:46:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.283+0000 7f6137bfd180 20 remove_watcher() i=2 2020-04-28T12:46:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.284+0000 7f6137bfd180 20 remove_watcher() i=3 2020-04-28T12:46:10.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.285+0000 7f6137bfd180 20 remove_watcher() i=4 2020-04-28T12:46:10.291 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.287+0000 7f6137bfd180 20 remove_watcher() i=5 2020-04-28T12:46:10.292 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.288+0000 7f6137bfd180 20 remove_watcher() i=6 2020-04-28T12:46:10.293 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.289+0000 7f6137bfd180 20 remove_watcher() i=7 2020-04-28T12:46:10.297 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:10.350 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2020-04-28T12:46:10.432 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.428+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.430+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.430+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.431+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.431+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.431+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.431+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.432+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:46:10.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:46:10.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:46:10.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:46:10.451 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.451 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.446+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:10.452 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.447+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.448+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.448+0000 7f48dd5ab180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.448+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.448+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.448+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 zonegroup default 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 10 Cannot find current period zone using local zone 2020-04-28T12:46:10.455 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.449+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.456 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.456 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 zone default found 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.450+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x55b93ee4bda0 msgr2=0x55b93ee4e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:10.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:10.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48dd5ab180 20 started sync module instance, tier type = 2020-04-28T12:46:10.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.451+0000 7f48dd5ab180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=0 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=1 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=2 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=3 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=4 2020-04-28T12:46:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=5 2020-04-28T12:46:10.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.462+0000 7f48dd5ab180 20 add_watcher() i=6 2020-04-28T12:46:10.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.464+0000 7f48dd5ab180 20 add_watcher() i=7 2020-04-28T12:46:10.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.464+0000 7f48dd5ab180 2 all 8 watchers are set, enabling cache 2020-04-28T12:46:10.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.464+0000 7f48dd5ab180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:46:10.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.464+0000 7f48dd5ab180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:46:10.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.464+0000 7f489bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:10.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.465+0000 7f48cbd95700 0 -- 172.21.15.92:0/3817607084 >> v1:172.21.15.138:6789/0 conn(0x55b93ee68a40 legacy=0x55b93ee69660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:46:10.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.516+0000 7f480a7fc700 20 reqs_thread_entry: start 2020-04-28T12:46:10.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.516+0000 7f4803fff700 20 reqs_thread_entry: start 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.516+0000 7f48dd5ab180 20 init_complete bucket index max shards: 1999 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48027fc700 20 reqs_thread_entry: start 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac7962a8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2020-04-28T12:46:10.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:46:10.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:10.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:10.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:46:10.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.517+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.518+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:46:10.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.518+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2020-04-28T12:46:10.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.518+0000 7f48dd5ab180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:46:10.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.518+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-conf state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:10.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.518+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=200 2020-04-28T12:46:10.526 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2020-04-28T12:46:10.526 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:46:10.526 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:10.526 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.519+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 : miss 2020-04-28T12:46:10.527 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 info.flags=0x16 2020-04-28T12:46:10.527 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 to cache LRU end 2020-04-28T12:46:10.527 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:10.527 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:10.527 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.520+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=293 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 info.flags=0x13 2020-04-28T12:46:10.528 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 to cache LRU end 2020-04-28T12:46:10.529 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:10.529 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:10.529 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.521+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 2020-04-28T12:46:10.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.634+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-conf[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1]) start_after [] num_entries 1100 2020-04-28T12:46:10.718 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.714+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2020-04-28T12:46:10.744 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.740+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2020-04-28T12:46:10.886 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.882+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x55b93ee486f0 msgr2=0x55b93ee4aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.892+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48c4004320 msgr2=0x7f48c4004740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:10.901 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:10.897+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48bc03c6a0 msgr2=0x7f48b80638e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.026 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.021+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x55b93ee4bda0 msgr2=0x7f48b80611b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.206+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2020-04-28T12:46:11.220 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.216+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2020-04-28T12:46:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.269+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2020-04-28T12:46:11.366 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.362+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2020-04-28T12:46:11.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.379+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2020-04-28T12:46:11.499 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.494+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2020-04-28T12:46:11.548 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.544+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2020-04-28T12:46:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 10 manifest: total_size = 4834 2020-04-28T12:46:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.56 2020-04-28T12:46:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.620+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.162 2020-04-28T12:46:11.628 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : miss 2020-04-28T12:46:11.628 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : miss 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.624+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 10 manifest: total_size = 12926 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.30 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.625+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.215 2020-04-28T12:46:11.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.628+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.628+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.629+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.630+0000 7f48dd5ab180 10 manifest: total_size = 12911 2020-04-28T12:46:11.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.630+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.13 2020-04-28T12:46:11.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.630+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.630+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.630+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1143 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.633+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.633+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.633+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.633+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.633+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.648 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 10 manifest: total_size = 15790 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.247 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.634+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1162 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.638+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.652 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.639+0000 7f48dd5ab180 10 manifest: total_size = 7611 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.639+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.120 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.639+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.639+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.639+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1273 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.642+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.642+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.655 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.655 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.655 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.643+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.644+0000 7f48dd5ab180 10 manifest: total_size = 7797 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.644+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.190 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.644+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.644+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.644+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1462 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.658 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.647+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.659 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 10 manifest: total_size = 12654 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.72 2020-04-28T12:46:11.660 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.648+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1499 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.651+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.651+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.661 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.662 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.652+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.653+0000 7f48dd5ab180 10 manifest: total_size = 5309 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.653+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.323 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.653+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.653+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.653+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1735 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.656+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 10 manifest: total_size = 13393 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.87 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b93f0271d8 s->prefetch_data=0 2020-04-28T12:46:11.667 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.657+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0271d8 2020-04-28T12:46:11.668 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.658+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1.1841 2020-04-28T12:46:11.668 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.660+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.668 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.660+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.669 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.669 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.669 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.669 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:11.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:11.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:11.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:11.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.661+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-conf[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:11.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.662+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:11.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.674+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x55b93ee486f0 msgr2=0x7f48b8066600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.748 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.743+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x55b93ee4bda0 msgr2=0x7f48b80611b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.769 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.765+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x55b93ee4fea0 msgr2=0x7f48b8066180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.775 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.771+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:11.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.771+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:11.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.771+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:11.776 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.771+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:11.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.796+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48c4004320 msgr2=0x7f48b80640a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.857+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48c0002670 msgr2=0x7f48b806ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:11.876 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.872+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-conf state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:11.876 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.872+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:11.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-conf from cache 2020-04-28T12:46:11.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2020-04-28T12:46:11.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.873+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94254111099840 notifier 4920 bl.length()=162 2020-04-28T12:46:11.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.875+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.1 from cache 2020-04-28T12:46:11.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.875+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=219 2020-04-28T12:46:11.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:11.876+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94254112558352 notifier 4920 bl.length()=219 2020-04-28T12:46:12.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.232+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:12.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.232+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:46:12.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=229 2020-04-28T12:46:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2020-04-28T12:46:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:46:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.233+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 : miss 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 info.flags=0x16 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 to cache LRU end 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:12.240 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=322 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 info.flags=0x13 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 to cache LRU end 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:12.241 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:12.242 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.234+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 2020-04-28T12:46:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.292+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48c0003b30 msgr2=0x7f48b8074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:12.345 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.340+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2]) start_after [] num_entries 1100 2020-04-28T12:46:12.696 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.692+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b805c6a0 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:12.818 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.813+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8066180 msgr2=0x7f48b8075e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:12.934 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:12.930+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:46:13.320 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 10 manifest: total_size = 1848 2020-04-28T12:46:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.20 2020-04-28T12:46:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:13.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.316+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2.1201 2020-04-28T12:46:13.324 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:46:13.324 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:13.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:13.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:46:13.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:46:13.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.320+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2020-04-28T12:46:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=515 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6293001 part_ofs=1545 rule->part_size=303 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2020-04-28T12:46:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.321+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.20 2020-04-28T12:46:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.323+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.323+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.323+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:13.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.390+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48c0002670 msgr2=0x7f48b806ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.393+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b80648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.401 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.397+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b806e030 msgr2=0x7f48b8074770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.432 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.427+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b80640a0 msgr2=0x7f48b80648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.429+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:13.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.429+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:13.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.429+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:13.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.429+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:13.459 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.455+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48c0003b30 msgr2=0x7f48b8074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.460+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8066180 msgr2=0x7f48b8075e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.496+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48bc03c6a0 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.510 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.506+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8072760 msgr2=0x7f48b80765c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:13.511 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.506+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8075720 msgr2=0x7f48b806ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:13.517 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.513+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8065a90 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.517+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b80640a0 msgr2=0x7f48b80648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.537 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:13.537 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:13.538 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2020-04-28T12:46:13.538 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:46:13.538 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:13.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:13.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:13.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2020-04-28T12:46:13.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.533+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2020-04-28T12:46:13.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.534+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94254112489968 notifier 4920 bl.length()=191 2020-04-28T12:46:13.543 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.536+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2 from cache 2020-04-28T12:46:13.543 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.536+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=248 2020-04-28T12:46:13.543 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.536+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94254112489968 notifier 4920 bl.length()=248 2020-04-28T12:46:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.619+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8076a20 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.756+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8076a20 msgr2=0x7f48b8075e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.889+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8075720 msgr2=0x7f48b806ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.893+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.893+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=236 2020-04-28T12:46:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2020-04-28T12:46:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:46:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 : miss 2020-04-28T12:46:13.901 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 info.flags=0x16 2020-04-28T12:46:13.901 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 to cache LRU end 2020-04-28T12:46:13.901 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:13.902 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:13.902 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.894+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:13.902 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:13.902 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:13.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:13.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:13.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=329 2020-04-28T12:46:13.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 info.flags=0x13 2020-04-28T12:46:13.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 to cache LRU end 2020-04-28T12:46:13.904 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:13.904 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:13.904 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.895+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 2020-04-28T12:46:13.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.944+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8072760 msgr2=0x7f48b8074fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:13.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.947+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b80648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:13.980 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:13.976+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8076a20 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.007+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8076a20 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:14.014 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.010+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3]) start_after [] num_entries 1100 2020-04-28T12:46:14.610 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.606+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:46:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.618+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8072760 msgr2=0x7f48b8074fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:14.940 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.935+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8076a20 msgr2=0x7f48b807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:14.970 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.966+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8065a90 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.998+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:15.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.999+0000 7f48dd5ab180 10 manifest: total_size = 886297 2020-04-28T12:46:15.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.999+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.40 2020-04-28T12:46:15.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.999+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:15.004 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.999+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:15.004 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:14.999+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3.1201 2020-04-28T12:46:15.006 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.002+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:46:15.006 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.002+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:15.008 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:46:15.009 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2020-04-28T12:46:15.010 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2020-04-28T12:46:15.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2020-04-28T12:46:15.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2020-04-28T12:46:15.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2020-04-28T12:46:15.011 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.003+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.40 2020-04-28T12:46:15.012 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.005+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:15.012 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.005+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-update-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:15.012 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.005+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:15.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.033+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8072760 msgr2=0x7f48b8074fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.081 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.073+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b806dbe0 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.124 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.120+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:15.124 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.120+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:15.124 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.120+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:15.124 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.120+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.153+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48c0003b30 msgr2=0x7f48b8074b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.162+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8075720 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.171+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8072760 msgr2=0x7f48b8074fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.172+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:15.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.204+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8064480 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.234 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.230+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:15.235 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.230+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:15.235 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2020-04-28T12:46:15.235 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2020-04-28T12:46:15.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.231+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94254112495488 notifier 4920 bl.length()=198 2020-04-28T12:46:15.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.233+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3 from cache 2020-04-28T12:46:15.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.233+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=255 2020-04-28T12:46:15.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.234+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94254111099840 notifier 4920 bl.length()=255 2020-04-28T12:46:15.291 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.287+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8065620 msgr2=0x7f48b8075bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.496 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.492+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b80774b0 msgr2=0x7f48b8074b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:15.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:46:15.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2020-04-28T12:46:15.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:15.583 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:15.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:15.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:15.584 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.578+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:15.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.579+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=231 2020-04-28T12:46:15.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.579+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2020-04-28T12:46:15.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.579+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:15.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.579+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:15.585 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.579+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 : miss 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 info.flags=0x16 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 to cache LRU end 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:15.586 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=324 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 info.flags=0x13 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 to cache LRU end 2020-04-28T12:46:15.587 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:15.588 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:15.588 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.580+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 2020-04-28T12:46:15.605 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.601+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8076a20 msgr2=0x7f48b8076210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.608 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.604+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8075720 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.630 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.625+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b806dbe0 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.673 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.669+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b80669e0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:15.708 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:15.704+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4]) start_after [] num_entries 1100 2020-04-28T12:46:16.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.209+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.304+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo[-aLEal.O5ZEW8iMY0MiCHGpXlrB01.U] 2020-04-28T12:46:16.372 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.368+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80669e0 msgr2=0x7f48b8078a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.417 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.413+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8076a20 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.447 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.443+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b80669e0 msgr2=0x7f48b8078a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.701 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.697+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.702 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.697+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:16.702 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.698+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to 3s77nh2zvo21dxiphyfivkddxcppjcs4 2020-04-28T12:46:16.702 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.698+0000 7f48dd5ab180 20 get_obj_state_impl: setting s->olh_tag to f0au2hoiirftpxyvrf1mtpsjjtufz8ba 2020-04-28T12:46:16.702 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.698+0000 7f48dd5ab180 20 bucket_index_guard_olh_op(): olh_state.olh_tag=f0au2hoiirftpxyvrf1mtpsjjtufz8ba 2020-04-28T12:46:16.703 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.699+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.705 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.701+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.705 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.701+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.706 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 olh_log_entry: epoch=3 op=2 key=[] 2020-04-28T12:46:16.706 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 olh_log_entry: epoch=3 op=3 key=foo[-aLEal.O5ZEW8iMY0MiCHGpXlrB01.U] 2020-04-28T12:46:16.706 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-index-versioning.1:_:-aLEal.O5ZEW8iMY0MiCHGpXlrB01.U_foo state=0x55b93f07c5c8 s->prefetch_data=0 2020-04-28T12:46:16.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 10 manifest: total_size = 886297 2020-04-28T12:46:16.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.55 2020-04-28T12:46:16.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-index-versioning.1:_:-aLEal.O5ZEW8iMY0MiCHGpXlrB01.U_foo state=0x55b93f07c5c8 s->prefetch_data=0 2020-04-28T12:46:16.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f07c5c8 2020-04-28T12:46:16.707 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.702+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.709 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.705+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:46:16.709 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.705+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:16.710 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:16.710 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:46:16.710 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:16.710 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:46:16.711 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:16.711 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:16.712 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:16.713 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:46:16.713 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:16.713 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:16.713 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2020-04-28T12:46:16.714 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2020-04-28T12:46:16.715 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.706+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.55 2020-04-28T12:46:16.715 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.709+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.715 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.709+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.717 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.713+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.719 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.714+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4.1201 2020-04-28T12:46:16.719 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.714+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:16.719 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.714+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:16.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:16.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:46:16.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:16.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:16.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:16.721 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:16.722 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.715+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-index-versioning.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:16.722 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.716+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:16.773 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.769+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b80774b0 msgr2=0x7f48b8074b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.786 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.782+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8065620 msgr2=0x7f48b8076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.924+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.924+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.924+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.924+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:16.940 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.936+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8074b50 msgr2=0x7f48b807b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.951+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80669e0 msgr2=0x7f48b8078a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:16.971 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.967+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:16.981 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:16.976+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b8078a30 msgr2=0x7f48b806d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.181+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8074fb0 msgr2=0x7f48b8064860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.191+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8075720 msgr2=0x7f48b806d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:17.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:17.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2020-04-28T12:46:17.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2020-04-28T12:46:17.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.196+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94254112495488 notifier 4920 bl.length()=193 2020-04-28T12:46:17.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.198+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4 from cache 2020-04-28T12:46:17.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.198+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=250 2020-04-28T12:46:17.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.199+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94254112495488 notifier 4920 bl.length()=250 2020-04-28T12:46:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.249+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807fc90 msgr2=0x7f48b806d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.430+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.439+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8076a20 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:17.506 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.502+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b806d170 msgr2=0x7f48b80828a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.561 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.556+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:17.561 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.556+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:46:17.561 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2020-04-28T12:46:17.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:46:17.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:17.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:17.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:17.562 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:17.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:46:17.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2020-04-28T12:46:17.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:46:17.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:17.563 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.557+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 : miss 2020-04-28T12:46:17.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 info.flags=0x16 2020-04-28T12:46:17.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 to cache LRU end 2020-04-28T12:46:17.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:17.565 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:17.565 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:17.565 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:17.565 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 info.flags=0x13 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 to cache LRU end 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:17.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:17.567 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.558+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 2020-04-28T12:46:17.613 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.609+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b806dbe0 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.635+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b80640a0 msgr2=0x7f48b80765b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.638+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.641+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8076a20 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.649 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.645+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8078a30 msgr2=0x7f48b807f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.694 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.690+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5]) start_after [] num_entries 1100 2020-04-28T12:46:17.791 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.786+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.797 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.793+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.867 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.863+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b80803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:17.897 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.893+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.000 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:17.996+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8074fb0 msgr2=0x7f48b8063870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:18.110 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.106+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8078a30 msgr2=0x7f48b8077bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.125 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.121+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b80803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.130 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.126+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.288 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.284+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:46:18.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:18.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 10 manifest: total_size = 74198 2020-04-28T12:46:18.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.71 2020-04-28T12:46:18.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:18.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:18.671 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.666+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5.1201 2020-04-28T12:46:18.674 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:46:18.674 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:18.675 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:18.675 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.670+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:46:18.676 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:46:18.677 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2020-04-28T12:46:18.678 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2020-04-28T12:46:18.679 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.671+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.71 2020-04-28T12:46:18.679 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.673+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:18.679 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.673+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-simple.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:18.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.673+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:18.688 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.684+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b8078a30 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:18.708 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.704+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80640a0 msgr2=0x7f48b80803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.715 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.711+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8074fb0 msgr2=0x7f48b80828a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.732+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b80640a0 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.756 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.752+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8074b50 msgr2=0x7f48b8078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.774+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8076a20 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.793+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.793+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.794+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:18.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.794+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:18.810 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.806+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8074b50 msgr2=0x7f48b8078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:18.820 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.816+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b80637e0 msgr2=0x7f48b807e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:18.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.878+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8074b50 msgr2=0x7f48b8078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2020-04-28T12:46:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:46:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2020-04-28T12:46:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2020-04-28T12:46:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.905+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94254112555440 notifier 4920 bl.length()=183 2020-04-28T12:46:18.912 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.908+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5 from cache 2020-04-28T12:46:18.912 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.908+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=240 2020-04-28T12:46:18.912 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.908+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94254112555440 notifier 4920 bl.length()=240 2020-04-28T12:46:18.987 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:18.983+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8078a30 msgr2=0x7f48b8076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:19.117 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.112+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b80640a0 msgr2=0x7f48b80803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:19.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:46:19.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2020-04-28T12:46:19.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:19.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.262+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=227 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:19.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:19.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 : miss 2020-04-28T12:46:19.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 info.flags=0x16 2020-04-28T12:46:19.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 to cache LRU end 2020-04-28T12:46:19.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:19.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:19.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:19.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.263+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=320 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 info.flags=0x13 2020-04-28T12:46:19.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 to cache LRU end 2020-04-28T12:46:19.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:19.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:19.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.264+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 2020-04-28T12:46:19.304 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.300+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b806dbe0 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.321+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8074fb0 msgr2=0x7f48b807ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:19.335 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.330+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.376+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7]) start_after [] num_entries 1100 2020-04-28T12:46:19.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.438+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:46:19.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.464+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:46:19.473 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.469+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:46:19.599 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.595+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b806dbe0 msgr2=0x7f48b80651c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.629 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.625+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:46:19.688 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.684+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:46:19.697 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.693+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b80640a0 msgr2=0x7f48b80803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.853 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.849+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:46:19.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.905+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8076a20 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.918 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.914+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807e5a0 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:19.927 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.923+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:46:19.946 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:19.942+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:46:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.074+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:46:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.084+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:46:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.186+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:46:20.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.193+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807e5a0 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.202+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:46:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.273+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.366+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.367+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.367+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.112 2020-04-28T12:46:20.371 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.367+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.367+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93effbc78 2020-04-28T12:46:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.367+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.126 2020-04-28T12:46:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.370+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:46:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.370+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.375 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:46:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.371+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.112 2020-04-28T12:46:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.373+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.374+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.374+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.114 2020-04-28T12:46:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.374+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.374+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93effbc78 2020-04-28T12:46:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.374+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.182 2020-04-28T12:46:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.383 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.377+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.378+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.114 2020-04-28T12:46:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.379+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.380+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.380+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _gJk7MyoFh35upv4TcIm0as-uTCcmmPq 2020-04-28T12:46:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.380+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.380+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93effbc78 2020-04-28T12:46:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.380+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.192 2020-04-28T12:46:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.383+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.383+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.389 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.384+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _gJk7MyoFh35upv4TcIm0as-uTCcmmPq 2020-04-28T12:46:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.108 2020-04-28T12:46:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b93effbc78 s->prefetch_data=0 2020-04-28T12:46:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93effbc78 2020-04-28T12:46:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.386+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.501 2020-04-28T12:46:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.395 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.390+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.108 2020-04-28T12:46:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _UBAfvmc_tDyxZzqpQR35rlreuMgBMIc 2020-04-28T12:46:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.392+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.625 2020-04-28T12:46:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.396+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.397+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _UBAfvmc_tDyxZzqpQR35rlreuMgBMIc 2020-04-28T12:46:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.398+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.398+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.398+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _di_IRlFkefcKEINUSwxL2vVcileROLj 2020-04-28T12:46:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.398+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.398+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.406 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.399+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.965 2020-04-28T12:46:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.407 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.402+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _di_IRlFkefcKEINUSwxL2vVcileROLj 2020-04-28T12:46:20.410 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.404+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.405+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.405+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _K0tsNG0B9_cI3z1a_3Rc-7Xl5tG3WwI 2020-04-28T12:46:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.405+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.405+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.405+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1116 2020-04-28T12:46:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.413 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.413 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.413 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.413 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.408+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.409+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _K0tsNG0B9_cI3z1a_3Rc-7Xl5tG3WwI 2020-04-28T12:46:20.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.411+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.412+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.412+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.119 2020-04-28T12:46:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.412+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.412+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.416 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.412+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1151 2020-04-28T12:46:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.420 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.415+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.416+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.119 2020-04-28T12:46:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.417+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.418+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.418+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _NF0p7m7nWcEdFQ0xdR-SGLgcR2859V2 2020-04-28T12:46:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.418+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.418+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.424 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.418+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1419 2020-04-28T12:46:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.425 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.427 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.421+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.428 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.429 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.422+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _NF0p7m7nWcEdFQ0xdR-SGLgcR2859V2 2020-04-28T12:46:20.430 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.423+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.430 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.424+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.424+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.116 2020-04-28T12:46:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.424+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.424+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.431 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.424+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1438 2020-04-28T12:46:20.432 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.427+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.432 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.427+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.428+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.428+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.428+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.428+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.428+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.435 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.429+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.116 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _LZJDJFISqYNgYV7ISjPemdd-ZcUuRzZ 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.431+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1634 2020-04-28T12:46:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.436+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.437+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _LZJDJFISqYNgYV7ISjPemdd-ZcUuRzZ 2020-04-28T12:46:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.438+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.439+0000 7f48dd5ab180 10 manifest: total_size = 5242880 2020-04-28T12:46:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.439+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.109 2020-04-28T12:46:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.439+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b93efd2ca8 s->prefetch_data=0 2020-04-28T12:46:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.439+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93efd2ca8 2020-04-28T12:46:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.439+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7.1668 2020-04-28T12:46:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.442+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.442+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:46:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:46:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.443+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.109 2020-04-28T12:46:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.445+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.445+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:20.450 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.445+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:20.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.453+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8074b50 msgr2=0x7f48b8078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:20.477 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.473+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807be70 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.516+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8078a30 msgr2=0x7f48b8064860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.518+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8074fb0 msgr2=0x7f48b807ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:20.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.554+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8063bc0 msgr2=0x7f48b80781a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.559+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:20.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.559+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:20.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.560+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:20.564 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.560+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:20.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:20.663 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:20.664 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2020-04-28T12:46:20.664 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:46:20.664 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:20.664 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:20.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:20.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2020-04-28T12:46:20.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.659+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2020-04-28T12:46:20.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.660+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94254112495488 notifier 4920 bl.length()=189 2020-04-28T12:46:20.665 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.661+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7 from cache 2020-04-28T12:46:20.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.661+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=246 2020-04-28T12:46:20.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.662+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879304 cookie 94254112495488 notifier 4920 bl.length()=246 2020-04-28T12:46:20.740 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.736+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807e5a0 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:20.791 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:20.745+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b806dbe0 msgr2=0x7f48b8065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:21.034 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.029+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:21.034 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.029+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:46:21.036 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2020-04-28T12:46:21.036 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:21.036 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:21.036 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=237 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:21.037 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.030+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 : miss 2020-04-28T12:46:21.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 info.flags=0x16 2020-04-28T12:46:21.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 to cache LRU end 2020-04-28T12:46:21.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:21.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:21.038 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.031+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=330 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 info.flags=0x13 2020-04-28T12:46:21.039 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 to cache LRU end 2020-04-28T12:46:21.040 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:21.040 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:21.040 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.032+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 2020-04-28T12:46:21.122 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.118+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807be70 msgr2=0x7f48b8077d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:21.142 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.137+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9]) start_after [] num_entries 1100 2020-04-28T12:46:21.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.199+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:46:21.230 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.226+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:46:21.234 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.230+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:46:21.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.232+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.311+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.384+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:46:21.451 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.447+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:46:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.611+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:46:21.689 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.685+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:46:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.701+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:46:21.835 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.831+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:46:21.844 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.840+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:46:21.895 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.890+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807be70 msgr2=0x7f48b8077d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:21.945 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.939+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:46:21.973 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:21.969+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:46:22.032 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.028+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8074b50 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.054 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.050+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8074fb0 msgr2=0x7f48b807ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.130+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.131+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.131+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.234 2020-04-28T12:46:22.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.131+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.131+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.136 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.131+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.126 2020-04-28T12:46:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.134+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:46:22.139 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.134+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.142 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.142 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.135+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:22.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.144 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:22.145 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.136+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.234 2020-04-28T12:46:22.145 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.137+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.145 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.138+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.138+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.236 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.138+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.138+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.138+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.182 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.141+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.146 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.141+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.147 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:22.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:22.152 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.142+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.236 2020-04-28T12:46:22.153 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _a5e5aO7E4E2dRVO34I1WIz1txWsWuWA 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.144+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.192 2020-04-28T12:46:22.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.147+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.147+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.157 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.157 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.157 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.148+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _a5e5aO7E4E2dRVO34I1WIz1txWsWuWA 2020-04-28T12:46:22.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.225 2020-04-28T12:46:22.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.158 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.159 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.150+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.501 2020-04-28T12:46:22.159 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.153+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.159 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.153+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.160 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.160 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.160 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.154+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.163 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.163 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:22.163 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.163 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:22.164 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.155+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.225 2020-04-28T12:46:22.164 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 10 manifest: total_size = 541681 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _aPklLWJpskaCcx29IwjVEf3tx6SsBHU 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.156+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.625 2020-04-28T12:46:22.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.166 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.160+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.167 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.167 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.167 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.161+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _aPklLWJpskaCcx29IwjVEf3tx6SsBHU 2020-04-28T12:46:22.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _fSb6aexyg2XEyFjhrLikmN-QEmPKCL9 2020-04-28T12:46:22.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.170 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.163+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.965 2020-04-28T12:46:22.170 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.166+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.171 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.166+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.171 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.167+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.171 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.167+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.172 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.167+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.172 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.167+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.172 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.167+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.174 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.174 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.168+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _fSb6aexyg2XEyFjhrLikmN-QEmPKCL9 2020-04-28T12:46:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.169+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.170+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.170+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _OBv5PZ3GAaJ85sGAzI7lVMEtgpPgZIU 2020-04-28T12:46:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.170+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.170+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.170+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1116 2020-04-28T12:46:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.181 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.181 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.181 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.181 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.174+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _OBv5PZ3GAaJ85sGAzI7lVMEtgpPgZIU 2020-04-28T12:46:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 10 manifest: total_size = 541681 2020-04-28T12:46:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.246 2020-04-28T12:46:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.183 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.177+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1151 2020-04-28T12:46:22.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.180+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.180+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.187 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.187 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.187 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b80640a0 msgr2=0x7f48b8075b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:22.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2020-04-28T12:46:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2020-04-28T12:46:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2020-04-28T12:46:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2020-04-28T12:46:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.181+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.246 2020-04-28T12:46:22.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _9K5k6M7R7WviNHN29rVo4A5aaYuvNQC 2020-04-28T12:46:22.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.183+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1419 2020-04-28T12:46:22.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.186+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.186+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.187+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _9K5k6M7R7WviNHN29rVo4A5aaYuvNQC 2020-04-28T12:46:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 10 manifest: total_size = 541681 2020-04-28T12:46:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.243 2020-04-28T12:46:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.189+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1438 2020-04-28T12:46:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.192+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.192+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.198 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:22.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:46:22.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:22.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:46:22.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:46:22.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2020-04-28T12:46:22.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2020-04-28T12:46:22.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2020-04-28T12:46:22.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2020-04-28T12:46:22.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.193+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.243 2020-04-28T12:46:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.195+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.196+0000 7f48dd5ab180 10 manifest: total_size = 541681 2020-04-28T12:46:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.196+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to _9smB4Rv9X6BVnqPOuirXg51GnR7WyZT 2020-04-28T12:46:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.196+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.196+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.196+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1634 2020-04-28T12:46:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.199+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.199+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.199+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2020-04-28T12:46:22.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.200+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _9smB4Rv9X6BVnqPOuirXg51GnR7WyZT 2020-04-28T12:46:22.209 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.201+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.202+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.202+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.226 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.202+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.202+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.202+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9.1668 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.205+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:22.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:22.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.206+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.226 2020-04-28T12:46:22.215 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.207+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:22.215 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.207+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:22.215 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.208+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:22.287 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.283+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.318 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.313+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:22.318 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.313+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:22.318 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.313+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:22.318 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.314+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:22.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.343+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b807e5a0 msgr2=0x7f48b807b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.365+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b806dbe0 msgr2=0x7f48b8064f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.385+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:22.399 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.395+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b806dbe0 msgr2=0x7f48b8080080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.413+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2020-04-28T12:46:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2020-04-28T12:46:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.414+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94254112498192 notifier 4920 bl.length()=199 2020-04-28T12:46:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.416+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9 from cache 2020-04-28T12:46:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.416+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=256 2020-04-28T12:46:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.417+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94254112498192 notifier 4920 bl.length()=256 2020-04-28T12:46:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.543+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.596 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.592+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b80640a0 msgr2=0x7f48b8075b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.656 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.652+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8076a20 msgr2=0x7f48b8078140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:46:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2020-04-28T12:46:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.773+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=232 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 : miss 2020-04-28T12:46:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 info.flags=0x16 2020-04-28T12:46:22.781 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 to cache LRU end 2020-04-28T12:46:22.781 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:22.781 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:22.781 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:22.781 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:22.782 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:22.782 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:22.782 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.774+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=325 2020-04-28T12:46:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 info.flags=0x13 2020-04-28T12:46:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 to cache LRU end 2020-04-28T12:46:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:22.783 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:22.784 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.775+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 2020-04-28T12:46:22.810 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.806+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.829 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.825+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.845+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8077520 msgr2=0x7f48b806d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.868 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.864+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80640a0 msgr2=0x7f48b8075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.869 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.865+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807b5b0 msgr2=0x7f48b8064860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.874 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.870+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8077520 msgr2=0x7f48b8076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:22.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.885+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8]) start_after [] num_entries 1100 2020-04-28T12:46:22.954 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:22.949+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:46:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.132+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:46:23.352 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.347+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b80640a0 msgr2=0x7f48b8075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:23.516 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.511+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8074fb0 msgr2=0x7f48b807b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.592+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:46:23.874 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.875 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:23.875 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.204 2020-04-28T12:46:23.875 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.875 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.870+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8.126 2020-04-28T12:46:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:46:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.874+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:23.881 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:23.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:23.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:23.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:23.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:23.882 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:23.883 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.875+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.204 2020-04-28T12:46:23.883 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.876+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.883 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.877+0000 7f48dd5ab180 10 manifest: total_size = 11534336 2020-04-28T12:46:23.883 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.877+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.197 2020-04-28T12:46:23.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.877+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.877+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:23.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.877+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8.501 2020-04-28T12:46:23.884 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:23.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.880+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.886 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.886 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.886 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:23.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:46:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.881+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.197 2020-04-28T12:46:23.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.882+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.883+0000 7f48dd5ab180 10 manifest: total_size = 45360 2020-04-28T12:46:23.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.883+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.211 2020-04-28T12:46:23.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.883+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:23.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.883+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:23.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.883+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8.1438 2020-04-28T12:46:23.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.886+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:23.890 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.886+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.891 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.887+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.891 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.887+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.892 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.887+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.892 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.887+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:23.892 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.887+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:23.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2020-04-28T12:46:23.894 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2020-04-28T12:46:23.895 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2020-04-28T12:46:23.895 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2020-04-28T12:46:23.895 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2020-04-28T12:46:23.895 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.888+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.211 2020-04-28T12:46:23.896 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.889+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:23.896 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.889+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:23.896 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.890+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:23.932 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.927+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:23.949 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.945+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b807b5b0 msgr2=0x7f48b806d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:23.963 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.959+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:23.964 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.960+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b8076a20 msgr2=0x7f48b8078140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:24.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.999+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:24.003 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.999+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:24.004 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.999+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:24.004 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:23.999+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:24.100 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.096+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.104+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.104+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2020-04-28T12:46:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:46:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2020-04-28T12:46:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2020-04-28T12:46:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.105+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94254112557312 notifier 4920 bl.length()=194 2020-04-28T12:46:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.107+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8 from cache 2020-04-28T12:46:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.107+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=251 2020-04-28T12:46:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.107+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94254112498192 notifier 4920 bl.length()=251 2020-04-28T12:46:24.115 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.111+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8074b50 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:46:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2020-04-28T12:46:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.457+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=222 2020-04-28T12:46:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2020-04-28T12:46:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 : miss 2020-04-28T12:46:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 info.flags=0x16 2020-04-28T12:46:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 to cache LRU end 2020-04-28T12:46:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:24.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:24.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:24.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.458+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:24.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=315 2020-04-28T12:46:24.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 info.flags=0x13 2020-04-28T12:46:24.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 to cache LRU end 2020-04-28T12:46:24.470 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:24.471 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:24.471 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.459+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 2020-04-28T12:46:24.546 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.541+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:24.575 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.570+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6]) start_after [] num_entries 1100 2020-04-28T12:46:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.636+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:46:24.823 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.819+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:46:24.842 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.837+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:24.965 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:24.961+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8077520 msgr2=0x7f48b807c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.115 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.111+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8074b50 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.265+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:46:25.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.278+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8076a20 msgr2=0x7f48b8078140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.307 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.303+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.534+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.535+0000 7f48dd5ab180 10 manifest: total_size = 10485760 2020-04-28T12:46:25.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.535+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.85 2020-04-28T12:46:25.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.535+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.539 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.535+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93ef9e858 2020-04-28T12:46:25.540 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.535+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6.126 2020-04-28T12:46:25.543 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.538+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:46:25.543 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.538+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.544 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:46:25.545 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:25.546 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:46:25.546 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.539+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.85 2020-04-28T12:46:25.546 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.541+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.542+0000 7f48dd5ab180 10 manifest: total_size = 10485760 2020-04-28T12:46:25.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.542+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.84 2020-04-28T12:46:25.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.542+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.542+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93ef9e858 2020-04-28T12:46:25.547 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.542+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6.501 2020-04-28T12:46:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.545+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:46:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.546+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.84 2020-04-28T12:46:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.547+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.548+0000 7f48dd5ab180 10 manifest: total_size = 10485760 2020-04-28T12:46:25.553 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.548+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.86 2020-04-28T12:46:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.548+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b93ef9e858 s->prefetch_data=0 2020-04-28T12:46:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.548+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93ef9e858 2020-04-28T12:46:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.548+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6.1438 2020-04-28T12:46:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.551+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.551+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.552+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:46:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:25.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:46:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:46:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.553+0000 7f48dd5ab180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.86 2020-04-28T12:46:25.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.554+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.554+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.555+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.586+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8065620 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.670 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.666+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.679 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.675+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.675+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.676+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.676+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:25.697 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.692+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b807be70 msgr2=0x7f48b8077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.802+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.807+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80640a0 msgr2=0x7f48b8080180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.820 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.816+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807f850 msgr2=0x7f48b807b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.823 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.819+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.833 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.827+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b80640a0 msgr2=0x7f48b8076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2020-04-28T12:46:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:46:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2020-04-28T12:46:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.835+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2020-04-28T12:46:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.836+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879305 cookie 94254112495488 notifier 4920 bl.length()=184 2020-04-28T12:46:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.838+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6 from cache 2020-04-28T12:46:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.838+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=241 2020-04-28T12:46:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:25.838+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94254111099840 notifier 4920 bl.length()=241 2020-04-28T12:46:26.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:26.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:46:26.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.184+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:26.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 : miss 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 info.flags=0x16 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 to cache LRU end 2020-04-28T12:46:26.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.185+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:26.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:46:26.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 info.flags=0x13 2020-04-28T12:46:26.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 to cache LRU end 2020-04-28T12:46:26.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:26.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:26.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.186+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 2020-04-28T12:46:26.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.242+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:26.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.276+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b80756b0 msgr2=0x7f48b805ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:26.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.295+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10]) start_after [] num_entries 1100 2020-04-28T12:46:26.354 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.350+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:46:26.469 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.465+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:46:26.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.628+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:46:26.893 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:26.889+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807f850 msgr2=0x7f48b807b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.044 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.040+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:46:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.257 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 10 manifest: total_size = 0 2020-04-28T12:46:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.306 2020-04-28T12:46:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0b0868 2020-04-28T12:46:27.258 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.253+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10.111 2020-04-28T12:46:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.256+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:46:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.256+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:46:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.257+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.258+0000 7f48dd5ab180 10 manifest: total_size = 0 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.258+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.305 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.258+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.258+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0b0868 2020-04-28T12:46:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.258+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10.349 2020-04-28T12:46:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.261+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.265 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.261+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.266 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.267 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.262+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.263+0000 7f48dd5ab180 10 manifest: total_size = 0 2020-04-28T12:46:27.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.263+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.307 2020-04-28T12:46:27.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.263+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.263+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0b0868 2020-04-28T12:46:27.269 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.263+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10.695 2020-04-28T12:46:27.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.266+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.266+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.267+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.268+0000 7f48dd5ab180 10 manifest: total_size = 0 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.268+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.308 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.268+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b93f0b0868 s->prefetch_data=0 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.268+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0b0868 2020-04-28T12:46:27.274 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.268+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10.1557 2020-04-28T12:46:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.270+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.270+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.271+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.271+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.271+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.271+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:27.276 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.271+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:46:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:27.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.272+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:27.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.298+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.341+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.365 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.361+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b8077520 msgr2=0x7f48b807c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.374+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b80756b0 msgr2=0x7f48b807e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.387+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:27.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.387+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:27.392 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.387+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:27.392 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.387+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.444+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b8074b50 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.462+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8078140 msgr2=0x7f48b80768a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2020-04-28T12:46:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.484+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:46:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.485+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879304 cookie 94254112489968 notifier 4920 bl.length()=181 2020-04-28T12:46:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.487+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.10 from cache 2020-04-28T12:46:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.487+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2020-04-28T12:46:27.491 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.487+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879305 cookie 94254112555440 notifier 4920 bl.length()=239 2020-04-28T12:46:27.695 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.691+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807c250 msgr2=0x7f48b8077520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:27.847 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:27.847 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:46:27.848 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2020-04-28T12:46:27.848 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:27.848 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:27.848 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.843+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:27.849 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 : miss 2020-04-28T12:46:27.850 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 info.flags=0x16 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 to cache LRU end 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:27.851 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.844+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 info.flags=0x13 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 to cache LRU end 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:27.852 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:27.853 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.845+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 2020-04-28T12:46:27.854 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.850+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.929 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.924+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f48b807b5b0 msgr2=0x7f48b8061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:27.936 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.931+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b807c250 msgr2=0x7f48b8077520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:27.972 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.968+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11]) start_after [] num_entries 1100 2020-04-28T12:46:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:27.988+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807f850 msgr2=0x7f48b807b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:28.027 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.023+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:46:28.142 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.138+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:46:28.296 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.292+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:28.307 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.303+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:46:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.716+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:46:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.931+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.932+0000 7f48dd5ab180 10 manifest: total_size = 524288 2020-04-28T12:46:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.932+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.313 2020-04-28T12:46:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.932+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.932+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.932+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11.111 2020-04-28T12:46:28.940 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:46:28.940 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.940 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:46:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.936+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 10 manifest: total_size = 62 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.312 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.943 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:28.944 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.937+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11.349 2020-04-28T12:46:28.944 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.940+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.944 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.940+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.945 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.945 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.945 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.945 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.946 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:28.947 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.941+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.942+0000 7f48dd5ab180 10 manifest: total_size = 24595 2020-04-28T12:46:28.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.942+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.314 2020-04-28T12:46:28.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.942+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.942+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:28.948 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.942+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11.695 2020-04-28T12:46:28.949 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.949 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.949 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.950 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.950 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.950 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.950 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.945+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.951 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.951 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.951 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.951 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:28.951 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.946+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.947+0000 7f48dd5ab180 10 manifest: total_size = 527 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.947+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.315 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.947+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b93eff3108 s->prefetch_data=0 2020-04-28T12:46:28.952 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.947+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93eff3108 2020-04-28T12:46:28.953 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.947+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11.1557 2020-04-28T12:46:28.954 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.954 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.950+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.2[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.951+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:28.966 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.962+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8078140 msgr2=0x7f48b807f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.963+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6802/23930,v1:172.21.15.92:6803/23930] conn(0x7f48b807be70 msgr2=0x7f48b8077ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:28.977 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:28.973+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8075650 msgr2=0x7f48b807e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.004 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.000+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8078eb0 msgr2=0x7f48b8065620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.013 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.009+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.022+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807be70 msgr2=0x7f48b8077ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.066 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.062+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807f850 msgr2=0x7f48b807b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.074+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.074+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.075+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.075+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.089+0000 7f48cad93700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7f48b807be70 msgr2=0x7f48b8077c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.115 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.110+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807be70 msgr2=0x7f48b8077c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.132 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.127+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b80640a0 msgr2=0x7f48b8068730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.167 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.163+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807be70 msgr2=0x7f48b8077bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.173+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:29.194 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:29.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2020-04-28T12:46:29.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:46:29.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:29.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:29.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:29.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2020-04-28T12:46:29.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.190+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:46:29.196 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.191+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879306 cookie 94254112489968 notifier 4920 bl.length()=181 2020-04-28T12:46:29.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.193+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.11 from cache 2020-04-28T12:46:29.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.193+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2020-04-28T12:46:29.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.193+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879307 cookie 94254112555440 notifier 4920 bl.length()=239 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.276+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b8075650 msgr2=0x7f48b8077720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.335 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.330+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8065620 msgr2=0x7f48b8078eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.343+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6818/24027,v1:172.21.15.92:6819/24027] conn(0x7f48b807be70 msgr2=0x7f48b8077bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:29.555 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.550+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55b93ecda3c0 s->prefetch_data=0 2020-04-28T12:46:29.555 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.550+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:46:29.556 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:29.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:46:29.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2020-04-28T12:46:29.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:29.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795bb0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:29.557 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.551+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 : miss 2020-04-28T12:46:29.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 info.flags=0x16 2020-04-28T12:46:29.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 to cache LRU end 2020-04-28T12:46:29.558 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 20 Read xattr: user.rgw.acl 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 20 Read xattr: user.rgw.idtag 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.552+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:29.559 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:46:29.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 info.flags=0x13 2020-04-28T12:46:29.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 to cache LRU end 2020-04-28T12:46:29.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:29.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:46:29.560 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.553+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 2020-04-28T12:46:29.596 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.592+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8078140 msgr2=0x7f48b807f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:29.666 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.662+0000 7f48dd5ab180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12]) start_after [] num_entries 1100 2020-04-28T12:46:29.720 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.716+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:46:29.834 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.829+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:46:30.001 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:29.997+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:46:30.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.374+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b8075650 msgr2=0x7f48b8077720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.414 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.409+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:46:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.459+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8078140 msgr2=0x7f48b807f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:30.626 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.626 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 10 manifest: total_size = 49187 2020-04-28T12:46:30.627 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.320 2020-04-28T12:46:30.627 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.627 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0bf658 2020-04-28T12:46:30.627 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.622+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12.111 2020-04-28T12:46:30.630 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:46:30.630 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.631 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.631 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.626+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.632 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 10 manifest: total_size = 4134 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.319 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.633 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0bf658 2020-04-28T12:46:30.634 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.627+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12.349 2020-04-28T12:46:30.634 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.630+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.635 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.630+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.635 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.636 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:30.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:30.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:30.637 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.631+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.632+0000 7f48dd5ab180 10 manifest: total_size = 1048576 2020-04-28T12:46:30.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.632+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.321 2020-04-28T12:46:30.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.632+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.632+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0bf658 2020-04-28T12:46:30.638 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.632+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12.695 2020-04-28T12:46:30.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.635+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.639 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.635+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.640 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:30.642 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:30.642 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:30.642 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.636+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.642 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.637+0000 7f48dd5ab180 10 manifest: total_size = 49187 2020-04-28T12:46:30.643 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.637+0000 7f48dd5ab180 20 get_obj_state: setting s->obj_tag to de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.322 2020-04-28T12:46:30.643 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.637+0000 7f48dd5ab180 20 get_obj_state: rctx=0x7fffac795b50 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b93f0bf658 s->prefetch_data=0 2020-04-28T12:46:30.643 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.637+0000 7f48dd5ab180 20 prepare_atomic_modification: state is not atomic. state=0x55b93f0bf658 2020-04-28T12:46:30.643 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.637+0000 7f48dd5ab180 20 bucket index object: default.rgw.buckets.index:.dir.de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12.1557 2020-04-28T12:46:30.644 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.644 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.645 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.645 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.645 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.645 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.640+0000 7f48dd5ab180 20 rados->read ofs=0 len=0 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 10 chain_cache_entry: cache_locator= 2020-04-28T12:46:30.646 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:46:30.647 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:46:30.647 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:46:30.647 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.3[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:46:30.647 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.641+0000 7f48dd5ab180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:46:30.688 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.684+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8075650 msgr2=0x7f48b8077720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.692 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.688+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6824/23038,v1:172.21.15.138:6825/23038] conn(0x7f48b807c250 msgr2=0x7f48b80772c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.752 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.748+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:46:30.752 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.748+0000 7f48dd5ab180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:46:30.752 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.748+0000 7f48dd5ab180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:46:30.753 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.748+0000 7f48dd5ab180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12])"; objs.size()=0; is_truncated=0 2020-04-28T12:46:30.770 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.766+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b807c250 msgr2=0x7f48b806d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.791+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8078140 msgr2=0x7f48b807f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.907 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.903+0000 7f48cbd95700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6816/23005,v1:172.21.15.138:6817/23005] conn(0x7f48b807be70 msgr2=0x7f48b8077b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:30.919 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.915+0000 7f48dd5ab180 20 get_system_obj_state: rctx=0x7fffac795348 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55b93ed16170 s->prefetch_data=0 2020-04-28T12:46:30.919 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.915+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:46:30.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2020-04-28T12:46:30.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:46:30.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:46:30.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:46:30.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2020-04-28T12:46:30.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2020-04-28T12:46:30.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:46:30.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.916+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879308 cookie 94254112489968 notifier 4920 bl.length()=181 2020-04-28T12:46:30.922 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.918+0000 7f48dd5ab180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.12 from cache 2020-04-28T12:46:30.922 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.918+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2020-04-28T12:46:30.923 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.918+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879309 cookie 94254112555440 notifier 4920 bl.length()=239 2020-04-28T12:46:30.971 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:30.965+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.92:6826/24056,v1:172.21.15.92:6827/24056] conn(0x7f48b807c250 msgr2=0x7f48b806d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:31.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.181+0000 7f48cb594700 0 -- 172.21.15.92:0/2980726801 >> [v2:172.21.15.138:6800/22915,v1:172.21.15.138:6801/22915] conn(0x7f48b8063bc0 msgr2=0x7f48b80789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.270+0000 7f48dd5ab180 10 removing key index: MRTSTFLXLMMLKLSIFBFU 2020-04-28T12:46:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.270+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2020-04-28T12:46:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.271+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879310 cookie 94254112555440 notifier 4920 bl.length()=170 2020-04-28T12:46:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.273+0000 7f48dd5ab180 10 removing email index: ragweed.client.0+test@test.test 2020-04-28T12:46:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.273+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2020-04-28T12:46:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.273+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879306 cookie 94254112495488 notifier 4920 bl.length()=182 2020-04-28T12:46:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.275+0000 7f48dd5ab180 10 removing user buckets index 2020-04-28T12:46:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.275+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2020-04-28T12:46:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.275+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94254112557312 notifier 4920 bl.length()=173 2020-04-28T12:46:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.277+0000 7f48dd5ab180 10 removing user index: ragweed.client.0 2020-04-28T12:46:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.277+0000 7f48dd5ab180 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2020-04-28T12:46:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.277+0000 7f48dd5ab180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2020-04-28T12:46:31.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.277+0000 7f48b0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879311 cookie 94254112555440 notifier 4920 bl.length()=165 2020-04-28T12:46:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.279+0000 7f489bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.281+0000 7f48dd5ab180 20 remove_watcher() i=0 2020-04-28T12:46:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.281+0000 7f48dd5ab180 2 removed watcher, disabling cache 2020-04-28T12:46:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.282+0000 7f48dd5ab180 20 remove_watcher() i=1 2020-04-28T12:46:31.288 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.284+0000 7f48dd5ab180 20 remove_watcher() i=2 2020-04-28T12:46:31.289 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.285+0000 7f48dd5ab180 20 remove_watcher() i=3 2020-04-28T12:46:31.291 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.287+0000 7f48dd5ab180 20 remove_watcher() i=4 2020-04-28T12:46:31.292 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.288+0000 7f48dd5ab180 20 remove_watcher() i=5 2020-04-28T12:46:31.293 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.289+0000 7f48dd5ab180 20 remove_watcher() i=6 2020-04-28T12:46:31.295 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:31.291+0000 7f48dd5ab180 20 remove_watcher() i=7 2020-04-28T12:46:31.299 INFO:tasks.ragweed:Removing ragweed... 2020-04-28T12:46:31.299 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:31.352 INFO:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/ragweed 2020-04-28T12:46:31.516 INFO:teuthology.run_tasks:Running task s3tests-java... 2020-04-28T12:46:31.530 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2020-04-28T12:46:31.530 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2020-04-28T12:46:31.531 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2020-04-28T12:46:31.531 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:31.545 INFO:teuthology.orchestra.run.smithi092:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2020-04-28T12:46:31.599 INFO:teuthology.orchestra.run.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2020-04-28T12:46:36.918 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2020-04-28T12:46:36.919 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:36.973 INFO:teuthology.orchestra.run.smithi092:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2020-04-28T12:46:38.333 INFO:teuthology.orchestra.run.smithi092.stdout: Gradle will be installed under /opt/gradle 2020-04-28T12:46:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:--2020-04-28 12:46:38-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:46:38.471 INFO:teuthology.orchestra.run.smithi092.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2020-04-28T12:46:38.487 INFO:teuthology.orchestra.run.smithi092.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2020-04-28T12:46:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2020-04-28T12:46:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip [following] 2020-04-28T12:46:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:--2020-04-28 12:46:38-- https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:46:38.612 INFO:teuthology.orchestra.run.smithi092.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:9f14, ... 2020-04-28T12:46:38.630 INFO:teuthology.orchestra.run.smithi092.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2020-04-28T12:46:38.709 INFO:teuthology.orchestra.run.smithi092.stderr:HTTP request sent, awaiting response... 200 OK 2020-04-28T12:46:38.720 INFO:teuthology.orchestra.run.smithi092.stderr:Length: 95129672 (91M) [application/zip] 2020-04-28T12:46:38.721 INFO:teuthology.orchestra.run.smithi092.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2020-04-28T12:46:38.721 INFO:teuthology.orchestra.run.smithi092.stderr: 2020-04-28T12:46:38.730 INFO:teuthology.orchestra.run.smithi092.stderr: 0K .......... .......... .......... .......... .......... 0% 6.28M 14s 2020-04-28T12:46:38.730 INFO:teuthology.orchestra.run.smithi092.stderr: 50K .......... .......... .......... .......... .......... 0% 54.3M 8s 2020-04-28T12:46:38.748 INFO:teuthology.orchestra.run.smithi092.stderr: 100K .......... .......... .......... .......... .......... 0% 2.94M 16s 2020-04-28T12:46:38.748 INFO:teuthology.orchestra.run.smithi092.stderr: 150K .......... .......... .......... .......... .......... 0% 66.9M 12s 2020-04-28T12:46:38.748 INFO:teuthology.orchestra.run.smithi092.stderr: 200K .......... .......... .......... .......... .......... 0% 45.2M 10s 2020-04-28T12:46:38.748 INFO:teuthology.orchestra.run.smithi092.stderr: 250K .......... .......... .......... .......... .......... 0% 52.3M 9s 2020-04-28T12:46:38.763 INFO:teuthology.orchestra.run.smithi092.stderr: 300K .......... .......... .......... .......... .......... 0% 3.12M 12s 2020-04-28T12:46:38.767 INFO:teuthology.orchestra.run.smithi092.stderr: 350K .......... .......... .......... .......... .......... 0% 59.0M 10s 2020-04-28T12:46:38.767 INFO:teuthology.orchestra.run.smithi092.stderr: 400K .......... .......... .......... .......... .......... 0% 52.8M 9s 2020-04-28T12:46:38.767 INFO:teuthology.orchestra.run.smithi092.stderr: 450K .......... .......... .......... .......... .......... 0% 68.3M 9s 2020-04-28T12:46:38.767 INFO:teuthology.orchestra.run.smithi092.stderr: 500K .......... .......... .......... .......... .......... 0% 53.3M 8s 2020-04-28T12:46:38.768 INFO:teuthology.orchestra.run.smithi092.stderr: 550K .......... .......... .......... .......... .......... 0% 48.2M 7s 2020-04-28T12:46:38.769 INFO:teuthology.orchestra.run.smithi092.stderr: 600K .......... .......... .......... .......... .......... 0% 68.0M 7s 2020-04-28T12:46:38.770 INFO:teuthology.orchestra.run.smithi092.stderr: 650K .......... .......... .......... .......... .......... 0% 39.0M 7s 2020-04-28T12:46:38.770 INFO:teuthology.orchestra.run.smithi092.stderr: 700K .......... .......... .......... .......... .......... 0% 71.2M 6s 2020-04-28T12:46:38.771 INFO:teuthology.orchestra.run.smithi092.stderr: 750K .......... .......... .......... .......... .......... 0% 51.2M 6s 2020-04-28T12:46:38.780 INFO:teuthology.orchestra.run.smithi092.stderr: 800K .......... .......... .......... .......... .......... 0% 5.26M 7s 2020-04-28T12:46:38.781 INFO:teuthology.orchestra.run.smithi092.stderr: 850K .......... .......... .......... .......... .......... 0% 61.6M 6s 2020-04-28T12:46:38.782 INFO:teuthology.orchestra.run.smithi092.stderr: 900K .......... .......... .......... .......... .......... 1% 44.8M 6s 2020-04-28T12:46:38.784 INFO:teuthology.orchestra.run.smithi092.stderr: 950K .......... .......... .......... .......... .......... 1% 48.2M 6s 2020-04-28T12:46:38.784 INFO:teuthology.orchestra.run.smithi092.stderr: 1000K .......... .......... .......... .......... .......... 1% 65.3M 6s 2020-04-28T12:46:38.785 INFO:teuthology.orchestra.run.smithi092.stderr: 1050K .......... .......... .......... .......... .......... 1% 51.8M 5s 2020-04-28T12:46:38.787 INFO:teuthology.orchestra.run.smithi092.stderr: 1100K .......... .......... .......... .......... .......... 1% 52.2M 5s 2020-04-28T12:46:38.788 INFO:teuthology.orchestra.run.smithi092.stderr: 1150K .......... .......... .......... .......... .......... 1% 51.8M 5s 2020-04-28T12:46:38.788 INFO:teuthology.orchestra.run.smithi092.stderr: 1200K .......... .......... .......... .......... .......... 1% 64.8M 5s 2020-04-28T12:46:38.790 INFO:teuthology.orchestra.run.smithi092.stderr: 1250K .......... .......... .......... .......... .......... 1% 52.9M 5s 2020-04-28T12:46:38.790 INFO:teuthology.orchestra.run.smithi092.stderr: 1300K .......... .......... .......... .......... .......... 1% 52.4M 5s 2020-04-28T12:46:38.790 INFO:teuthology.orchestra.run.smithi092.stderr: 1350K .......... .......... .......... .......... .......... 1% 50.0M 5s 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi092.stderr: 1400K .......... .......... .......... .......... .......... 1% 54.7M 5s 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi092.stderr: 1450K .......... .......... .......... .......... .......... 1% 67.2M 4s 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi092.stderr: 1500K .......... .......... .......... .......... .......... 1% 66.3M 4s 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi092.stderr: 1550K .......... .......... .......... .......... .......... 1% 46.3M 4s 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi092.stderr: 1600K .......... .......... .......... .......... .......... 1% 80.3M 4s 2020-04-28T12:46:38.797 INFO:teuthology.orchestra.run.smithi092.stderr: 1650K .......... .......... .......... .......... .......... 1% 33.2M 4s 2020-04-28T12:46:38.797 INFO:teuthology.orchestra.run.smithi092.stderr: 1700K .......... .......... .......... .......... .......... 1% 35.4M 4s 2020-04-28T12:46:38.798 INFO:teuthology.orchestra.run.smithi092.stderr: 1750K .......... .......... .......... .......... .......... 1% 68.9M 4s 2020-04-28T12:46:38.799 INFO:teuthology.orchestra.run.smithi092.stderr: 1800K .......... .......... .......... .......... .......... 1% 76.1M 4s 2020-04-28T12:46:39.957 INFO:teuthology.orchestra.run.smithi092.stderr: 1850K .......... .......... .......... .......... .......... 2% 61.7M 4s 2020-04-28T12:46:39.958 INFO:teuthology.orchestra.run.smithi092.stderr: 1900K .......... .......... .......... .......... .......... 2% 61.9M 4s 2020-04-28T12:46:39.958 INFO:teuthology.orchestra.run.smithi092.stderr: 1950K .......... .......... .......... .......... .......... 2% 54.4M 4s 2020-04-28T12:46:39.958 INFO:teuthology.orchestra.run.smithi092.stderr: 2000K .......... .......... .......... .......... .......... 2% 140M 4s 2020-04-28T12:46:39.958 INFO:teuthology.orchestra.run.smithi092.stderr: 2050K .......... .......... .......... .......... .......... 2% 109M 4s 2020-04-28T12:46:39.958 INFO:teuthology.orchestra.run.smithi092.stderr: 2100K .......... .......... .......... .......... .......... 2% 118M 4s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2150K .......... .......... .......... .......... .......... 2% 90.9M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2200K .......... .......... .......... .......... .......... 2% 115M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2250K .......... .......... .......... .......... .......... 2% 151M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2300K .......... .......... .......... .......... .......... 2% 96.5M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2350K .......... .......... .......... .......... .......... 2% 75.1M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2400K .......... .......... .......... .......... .......... 2% 98.4M 3s 2020-04-28T12:46:39.959 INFO:teuthology.orchestra.run.smithi092.stderr: 2450K .......... .......... .......... .......... .......... 2% 114M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2500K .......... .......... .......... .......... .......... 2% 94.4M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2550K .......... .......... .......... .......... .......... 2% 89.8M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2600K .......... .......... .......... .......... .......... 2% 94.6M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2650K .......... .......... .......... .......... .......... 2% 125M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2700K .......... .......... .......... .......... .......... 2% 54.1M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2750K .......... .......... .......... .......... .......... 3% 63.4M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2800K .......... .......... .......... .......... .......... 3% 95.2M 3s 2020-04-28T12:46:39.960 INFO:teuthology.orchestra.run.smithi092.stderr: 2850K .......... .......... .......... .......... .......... 3% 114M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 2900K .......... .......... .......... .......... .......... 3% 110M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 2950K .......... .......... .......... .......... .......... 3% 113M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 3000K .......... .......... .......... .......... .......... 3% 113M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 3050K .......... .......... .......... .......... .......... 3% 88.1M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 3100K .......... .......... .......... .......... .......... 3% 111M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 3150K .......... .......... .......... .......... .......... 3% 112M 3s 2020-04-28T12:46:39.961 INFO:teuthology.orchestra.run.smithi092.stderr: 3200K .......... .......... .......... .......... .......... 3% 101M 3s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3250K .......... .......... .......... .......... .......... 3% 115M 3s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3300K .......... .......... .......... .......... .......... 3% 104M 3s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3350K .......... .......... .......... .......... .......... 3% 105M 3s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3400K .......... .......... .......... .......... .......... 3% 104M 2s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3450K .......... .......... .......... .......... .......... 3% 95.3M 2s 2020-04-28T12:46:39.962 INFO:teuthology.orchestra.run.smithi092.stderr: 3500K .......... .......... .......... .......... .......... 3% 110M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3550K .......... .......... .......... .......... .......... 3% 88.0M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3600K .......... .......... .......... .......... .......... 3% 107M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3650K .......... .......... .......... .......... .......... 3% 113M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3700K .......... .......... .......... .......... .......... 4% 114M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3750K .......... .......... .......... .......... .......... 4% 101M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3800K .......... .......... .......... .......... .......... 4% 106M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3850K .......... .......... .......... .......... .......... 4% 113M 2s 2020-04-28T12:46:39.963 INFO:teuthology.orchestra.run.smithi092.stderr: 3900K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 3950K .......... .......... .......... .......... .......... 4% 110M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4000K .......... .......... .......... .......... .......... 4% 103M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4050K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4100K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4150K .......... .......... .......... .......... .......... 4% 98.3M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4200K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:46:39.964 INFO:teuthology.orchestra.run.smithi092.stderr: 4250K .......... .......... .......... .......... .......... 4% 97.9M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4300K .......... .......... .......... .......... .......... 4% 114M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4350K .......... .......... .......... .......... .......... 4% 83.8M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4400K .......... .......... .......... .......... .......... 4% 135M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4450K .......... .......... .......... .......... .......... 4% 118M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4500K .......... .......... .......... .......... .......... 4% 117M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4550K .......... .......... .......... .......... .......... 4% 108M 2s 2020-04-28T12:46:39.965 INFO:teuthology.orchestra.run.smithi092.stderr: 4600K .......... .......... .......... .......... .......... 5% 107M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4650K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4700K .......... .......... .......... .......... .......... 5% 113M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4750K .......... .......... .......... .......... .......... 5% 94.5M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4800K .......... .......... .......... .......... .......... 5% 114M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4850K .......... .......... .......... .......... .......... 5% 114M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4900K .......... .......... .......... .......... .......... 5% 111M 2s 2020-04-28T12:46:39.966 INFO:teuthology.orchestra.run.smithi092.stderr: 4950K .......... .......... .......... .......... .......... 5% 115M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5000K .......... .......... .......... .......... .......... 5% 122M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5050K .......... .......... .......... .......... .......... 5% 108M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5100K .......... .......... .......... .......... .......... 5% 120M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5150K .......... .......... .......... .......... .......... 5% 89.0M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5200K .......... .......... .......... .......... .......... 5% 120M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5250K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:46:39.967 INFO:teuthology.orchestra.run.smithi092.stderr: 5300K .......... .......... .......... .......... .......... 5% 91.0M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5350K .......... .......... .......... .......... .......... 5% 116M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5400K .......... .......... .......... .......... .......... 5% 111M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5450K .......... .......... .......... .......... .......... 5% 123M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5500K .......... .......... .......... .......... .......... 5% 112M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5550K .......... .......... .......... .......... .......... 6% 94.5M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5600K .......... .......... .......... .......... .......... 6% 117M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5650K .......... .......... .......... .......... .......... 6% 96.9M 2s 2020-04-28T12:46:39.968 INFO:teuthology.orchestra.run.smithi092.stderr: 5700K .......... .......... .......... .......... .......... 6% 150M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 5750K .......... .......... .......... .......... .......... 6% 70.5M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 5800K .......... .......... .......... .......... .......... 6% 84.9M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 5850K .......... .......... .......... .......... .......... 6% 119M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 5900K .......... .......... .......... .......... .......... 6% 108M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 5950K .......... .......... .......... .......... .......... 6% 83.4M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 6000K .......... .......... .......... .......... .......... 6% 112M 2s 2020-04-28T12:46:39.969 INFO:teuthology.orchestra.run.smithi092.stderr: 6050K .......... .......... .......... .......... .......... 6% 109M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6100K .......... .......... .......... .......... .......... 6% 80.3M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6150K .......... .......... .......... .......... .......... 6% 78.3M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6200K .......... .......... .......... .......... .......... 6% 105M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6250K .......... .......... .......... .......... .......... 6% 76.3M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6300K .......... .......... .......... .......... .......... 6% 77.1M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6350K .......... .......... .......... .......... .......... 6% 47.8M 2s 2020-04-28T12:46:39.970 INFO:teuthology.orchestra.run.smithi092.stderr: 6400K .......... .......... .......... .......... .......... 6% 71.1M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6450K .......... .......... .......... .......... .......... 6% 117M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6500K .......... .......... .......... .......... .......... 7% 93.6M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6550K .......... .......... .......... .......... .......... 7% 63.4M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6600K .......... .......... .......... .......... .......... 7% 70.3M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6650K .......... .......... .......... .......... .......... 7% 117M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6700K .......... .......... .......... .......... .......... 7% 62.3M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6750K .......... .......... .......... .......... .......... 7% 58.7M 2s 2020-04-28T12:46:39.971 INFO:teuthology.orchestra.run.smithi092.stderr: 6800K .......... .......... .......... .......... .......... 7% 92.0M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 6850K .......... .......... .......... .......... .......... 7% 115M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 6900K .......... .......... .......... .......... .......... 7% 95.9M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 6950K .......... .......... .......... .......... .......... 7% 129M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 7000K .......... .......... .......... .......... .......... 7% 120M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 7050K .......... .......... .......... .......... .......... 7% 101M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 7100K .......... .......... .......... .......... .......... 7% 106M 2s 2020-04-28T12:46:39.972 INFO:teuthology.orchestra.run.smithi092.stderr: 7150K .......... .......... .......... .......... .......... 7% 80.9M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7200K .......... .......... .......... .......... .......... 7% 118M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7250K .......... .......... .......... .......... .......... 7% 92.4M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7300K .......... .......... .......... .......... .......... 7% 147M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7350K .......... .......... .......... .......... .......... 7% 114M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7400K .......... .......... .......... .......... .......... 8% 113M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7450K .......... .......... .......... .......... .......... 8% 109M 2s 2020-04-28T12:46:39.973 INFO:teuthology.orchestra.run.smithi092.stderr: 7500K .......... .......... .......... .......... .......... 8% 107M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7550K .......... .......... .......... .......... .......... 8% 95.0M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7600K .......... .......... .......... .......... .......... 8% 52.9M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7650K .......... .......... .......... .......... .......... 8% 74.4M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7700K .......... .......... .......... .......... .......... 8% 117M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7750K .......... .......... .......... .......... .......... 8% 97.6M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7800K .......... .......... .......... .......... .......... 8% 114M 2s 2020-04-28T12:46:39.974 INFO:teuthology.orchestra.run.smithi092.stderr: 7850K .......... .......... .......... .......... .......... 8% 113M 2s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 7900K .......... .......... .......... .......... .......... 8% 122M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 7950K .......... .......... .......... .......... .......... 8% 78.9M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 8000K .......... .......... .......... .......... .......... 8% 136M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 8050K .......... .......... .......... .......... .......... 8% 116M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 8100K .......... .......... .......... .......... .......... 8% 117M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 8150K .......... .......... .......... .......... .......... 8% 114M 1s 2020-04-28T12:46:39.975 INFO:teuthology.orchestra.run.smithi092.stderr: 8200K .......... .......... .......... .......... .......... 8% 117M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8250K .......... .......... .......... .......... .......... 8% 82.2M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8300K .......... .......... .......... .......... .......... 8% 82.8M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8350K .......... .......... .......... .......... .......... 9% 74.1M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8400K .......... .......... .......... .......... .......... 9% 103M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8450K .......... .......... .......... .......... .......... 9% 115M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8500K .......... .......... .......... .......... .......... 9% 90.4M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8550K .......... .......... .......... .......... .......... 9% 81.9M 1s 2020-04-28T12:46:39.976 INFO:teuthology.orchestra.run.smithi092.stderr: 8600K .......... .......... .......... .......... .......... 9% 111M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8650K .......... .......... .......... .......... .......... 9% 117M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8700K .......... .......... .......... .......... .......... 9% 113M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8750K .......... .......... .......... .......... .......... 9% 78.8M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8800K .......... .......... .......... .......... .......... 9% 136M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8850K .......... .......... .......... .......... .......... 9% 116M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8900K .......... .......... .......... .......... .......... 9% 118M 1s 2020-04-28T12:46:39.977 INFO:teuthology.orchestra.run.smithi092.stderr: 8950K .......... .......... .......... .......... .......... 9% 88.3M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9000K .......... .......... .......... .......... .......... 9% 116M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9050K .......... .......... .......... .......... .......... 9% 110M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9100K .......... .......... .......... .......... .......... 9% 117M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9150K .......... .......... .......... .......... .......... 9% 84.2M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9200K .......... .......... .......... .......... .......... 9% 130M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9250K .......... .......... .......... .......... .......... 10% 104M 1s 2020-04-28T12:46:39.978 INFO:teuthology.orchestra.run.smithi092.stderr: 9300K .......... .......... .......... .......... .......... 10% 126M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9350K .......... .......... .......... .......... .......... 10% 105M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9400K .......... .......... .......... .......... .......... 10% 121M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9450K .......... .......... .......... .......... .......... 10% 113M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9500K .......... .......... .......... .......... .......... 10% 111M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9550K .......... .......... .......... .......... .......... 10% 93.7M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9600K .......... .......... .......... .......... .......... 10% 109M 1s 2020-04-28T12:46:39.979 INFO:teuthology.orchestra.run.smithi092.stderr: 9650K .......... .......... .......... .......... .......... 10% 122M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9700K .......... .......... .......... .......... .......... 10% 113M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9750K .......... .......... .......... .......... .......... 10% 114M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9800K .......... .......... .......... .......... .......... 10% 113M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9850K .......... .......... .......... .......... .......... 10% 111M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9900K .......... .......... .......... .......... .......... 10% 119M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 9950K .......... .......... .......... .......... .......... 10% 87.6M 1s 2020-04-28T12:46:39.980 INFO:teuthology.orchestra.run.smithi092.stderr: 10000K .......... .......... .......... .......... .......... 10% 114M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10050K .......... .......... .......... .......... .......... 10% 113M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10100K .......... .......... .......... .......... .......... 10% 120M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10150K .......... .......... .......... .......... .......... 10% 112M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10200K .......... .......... .......... .......... .......... 11% 114M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10250K .......... .......... .......... .......... .......... 11% 116M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10300K .......... .......... .......... .......... .......... 11% 107M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10350K .......... .......... .......... .......... .......... 11% 60.1M 1s 2020-04-28T12:46:39.981 INFO:teuthology.orchestra.run.smithi092.stderr: 10400K .......... .......... .......... .......... .......... 11% 116M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10450K .......... .......... .......... .......... .......... 11% 95.1M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10500K .......... .......... .......... .......... .......... 11% 98.9M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10550K .......... .......... .......... .......... .......... 11% 112M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10600K .......... .......... .......... .......... .......... 11% 118M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10650K .......... .......... .......... .......... .......... 11% 90.3M 1s 2020-04-28T12:46:39.982 INFO:teuthology.orchestra.run.smithi092.stderr: 10700K .......... .......... .......... .......... .......... 11% 75.9M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 10750K .......... .......... .......... .......... .......... 11% 60.2M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 10800K .......... .......... .......... .......... .......... 11% 92.5M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 10850K .......... .......... .......... .......... .......... 11% 114M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 10900K .......... .......... .......... .......... .......... 11% 71.8M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 10950K .......... .......... .......... .......... .......... 11% 69.8M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 11000K .......... .......... .......... .......... .......... 11% 111M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 11050K .......... .......... .......... .......... .......... 11% 102M 1s 2020-04-28T12:46:39.983 INFO:teuthology.orchestra.run.smithi092.stderr: 11100K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11150K .......... .......... .......... .......... .......... 12% 47.1M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11200K .......... .......... .......... .......... .......... 12% 77.7M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11250K .......... .......... .......... .......... .......... 12% 78.9M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11300K .......... .......... .......... .......... .......... 12% 75.8M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11350K .......... .......... .......... .......... .......... 12% 113M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11400K .......... .......... .......... .......... .......... 12% 68.7M 1s 2020-04-28T12:46:39.984 INFO:teuthology.orchestra.run.smithi092.stderr: 11450K .......... .......... .......... .......... .......... 12% 79.3M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11500K .......... .......... .......... .......... .......... 12% 53.6M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11550K .......... .......... .......... .......... .......... 12% 88.1M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11600K .......... .......... .......... .......... .......... 12% 124M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11650K .......... .......... .......... .......... .......... 12% 82.5M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11700K .......... .......... .......... .......... .......... 12% 123M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11750K .......... .......... .......... .......... .......... 12% 104M 1s 2020-04-28T12:46:39.985 INFO:teuthology.orchestra.run.smithi092.stderr: 11800K .......... .......... .......... .......... .......... 12% 79.6M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 11850K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 11900K .......... .......... .......... .......... .......... 12% 113M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 11950K .......... .......... .......... .......... .......... 12% 91.5M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 12000K .......... .......... .......... .......... .......... 12% 99.6M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 12050K .......... .......... .......... .......... .......... 13% 117M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 12100K .......... .......... .......... .......... .......... 13% 114M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 12150K .......... .......... .......... .......... .......... 13% 109M 1s 2020-04-28T12:46:39.986 INFO:teuthology.orchestra.run.smithi092.stderr: 12200K .......... .......... .......... .......... .......... 13% 95.6M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12250K .......... .......... .......... .......... .......... 13% 97.7M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12300K .......... .......... .......... .......... .......... 13% 108M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12350K .......... .......... .......... .......... .......... 13% 95.0M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12400K .......... .......... .......... .......... .......... 13% 101M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12450K .......... .......... .......... .......... .......... 13% 94.2M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12500K .......... .......... .......... .......... .......... 13% 56.6M 1s 2020-04-28T12:46:39.987 INFO:teuthology.orchestra.run.smithi092.stderr: 12550K .......... .......... .......... .......... .......... 13% 109M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12600K .......... .......... .......... .......... .......... 13% 65.2M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12650K .......... .......... .......... .......... .......... 13% 106M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12700K .......... .......... .......... .......... .......... 13% 111M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12750K .......... .......... .......... .......... .......... 13% 85.3M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12800K .......... .......... .......... .......... .......... 13% 122M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12850K .......... .......... .......... .......... .......... 13% 110M 1s 2020-04-28T12:46:39.988 INFO:teuthology.orchestra.run.smithi092.stderr: 12900K .......... .......... .......... .......... .......... 13% 110M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 12950K .......... .......... .......... .......... .......... 13% 113M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13000K .......... .......... .......... .......... .......... 14% 88.7M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13050K .......... .......... .......... .......... .......... 14% 132M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13100K .......... .......... .......... .......... .......... 14% 111M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13150K .......... .......... .......... .......... .......... 14% 86.1M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13200K .......... .......... .......... .......... .......... 14% 101M 1s 2020-04-28T12:46:39.989 INFO:teuthology.orchestra.run.smithi092.stderr: 13250K .......... .......... .......... .......... .......... 14% 102M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13300K .......... .......... .......... .......... .......... 14% 121M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13350K .......... .......... .......... .......... .......... 14% 102M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13400K .......... .......... .......... .......... .......... 14% 66.8M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13450K .......... .......... .......... .......... .......... 14% 136M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13500K .......... .......... .......... .......... .......... 14% 94.1M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13550K .......... .......... .......... .......... .......... 14% 89.5M 1s 2020-04-28T12:46:39.990 INFO:teuthology.orchestra.run.smithi092.stderr: 13600K .......... .......... .......... .......... .......... 14% 118M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13650K .......... .......... .......... .......... .......... 14% 84.5M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13700K .......... .......... .......... .......... .......... 14% 101M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13750K .......... .......... .......... .......... .......... 14% 104M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13800K .......... .......... .......... .......... .......... 14% 119M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13850K .......... .......... .......... .......... .......... 14% 118M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13900K .......... .......... .......... .......... .......... 15% 98.9M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 13950K .......... .......... .......... .......... .......... 15% 101M 1s 2020-04-28T12:46:39.991 INFO:teuthology.orchestra.run.smithi092.stderr: 14000K .......... .......... .......... .......... .......... 15% 116M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14050K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14100K .......... .......... .......... .......... .......... 15% 81.9M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14150K .......... .......... .......... .......... .......... 15% 75.0M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14200K .......... .......... .......... .......... .......... 15% 114M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14250K .......... .......... .......... .......... .......... 15% 128M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14300K .......... .......... .......... .......... .......... 15% 117M 1s 2020-04-28T12:46:39.992 INFO:teuthology.orchestra.run.smithi092.stderr: 14350K .......... .......... .......... .......... .......... 15% 77.6M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14400K .......... .......... .......... .......... .......... 15% 110M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14450K .......... .......... .......... .......... .......... 15% 112M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14500K .......... .......... .......... .......... .......... 15% 106M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14550K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14600K .......... .......... .......... .......... .......... 15% 99.1M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14650K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:46:39.993 INFO:teuthology.orchestra.run.smithi092.stderr: 14700K .......... .......... .......... .......... .......... 15% 111M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 14750K .......... .......... .......... .......... .......... 15% 81.0M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 14800K .......... .......... .......... .......... .......... 15% 124M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 14850K .......... .......... .......... .......... .......... 16% 97.4M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 14900K .......... .......... .......... .......... .......... 16% 120M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 14950K .......... .......... .......... .......... .......... 16% 67.6M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 15000K .......... .......... .......... .......... .......... 16% 123M 1s 2020-04-28T12:46:39.994 INFO:teuthology.orchestra.run.smithi092.stderr: 15050K .......... .......... .......... .......... .......... 16% 86.6M 1s 2020-04-28T12:46:39.995 INFO:teuthology.orchestra.run.smithi092.stderr: 15100K .......... .......... .......... .......... .......... 16% 100M 1s 2020-04-28T12:46:39.995 INFO:teuthology.orchestra.run.smithi092.stderr: 15150K .......... .......... .......... .......... .......... 16% 87.3M 1s 2020-04-28T12:46:39.995 INFO:teuthology.orchestra.run.smithi092.stderr: 15200K .......... .......... .......... .......... .......... 16% 109M 1s 2020-04-28T12:46:39.995 INFO:teuthology.orchestra.run.smithi092.stderr: 15250K .......... .......... .......... .......... .......... 16% 108M 1s 2020-04-28T12:46:39.995 INFO:teuthology.orchestra.run.smithi092.stderr: 15300K .......... .......... .......... .......... .......... 16% 109M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15350K .......... .......... .......... .......... .......... 16% 80.6M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15400K .......... .......... .......... .......... .......... 16% 79.3M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15450K .......... .......... .......... .......... .......... 16% 83.1M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15500K .......... .......... .......... .......... .......... 16% 121M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15550K .......... .......... .......... .......... .......... 16% 57.8M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15600K .......... .......... .......... .......... .......... 16% 68.6M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15650K .......... .......... .......... .......... .......... 16% 112M 1s 2020-04-28T12:46:39.996 INFO:teuthology.orchestra.run.smithi092.stderr: 15700K .......... .......... .......... .......... .......... 16% 90.5M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 15750K .......... .......... .......... .......... .......... 17% 118M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 15800K .......... .......... .......... .......... .......... 17% 52.3M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 15850K .......... .......... .......... .......... .......... 17% 96.3M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 15900K .......... .......... .......... .......... .......... 17% 56.3M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 15950K .......... .......... .......... .......... .......... 17% 42.7M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 16000K .......... .......... .......... .......... .......... 17% 44.1M 1s 2020-04-28T12:46:39.997 INFO:teuthology.orchestra.run.smithi092.stderr: 16050K .......... .......... .......... .......... .......... 17% 88.6M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16100K .......... .......... .......... .......... .......... 17% 114M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16150K .......... .......... .......... .......... .......... 17% 108M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16200K .......... .......... .......... .......... .......... 17% 85.5M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16250K .......... .......... .......... .......... .......... 17% 84.6M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16300K .......... .......... .......... .......... .......... 17% 115M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16350K .......... .......... .......... .......... .......... 17% 61.2M 1s 2020-04-28T12:46:39.998 INFO:teuthology.orchestra.run.smithi092.stderr: 16400K .......... .......... .......... .......... .......... 17% 90.4M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16450K .......... .......... .......... .......... .......... 17% 80.2M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16500K .......... .......... .......... .......... .......... 17% 118M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16550K .......... .......... .......... .......... .......... 17% 72.2M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16600K .......... .......... .......... .......... .......... 17% 89.4M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16650K .......... .......... .......... .......... .......... 17% 116M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16700K .......... .......... .......... .......... .......... 18% 120M 1s 2020-04-28T12:46:39.999 INFO:teuthology.orchestra.run.smithi092.stderr: 16750K .......... .......... .......... .......... .......... 18% 85.7M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 16800K .......... .......... .......... .......... .......... 18% 109M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 16850K .......... .......... .......... .......... .......... 18% 120M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 16900K .......... .......... .......... .......... .......... 18% 104M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 16950K .......... .......... .......... .......... .......... 18% 106M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 17000K .......... .......... .......... .......... .......... 18% 124M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 17050K .......... .......... .......... .......... .......... 18% 112M 1s 2020-04-28T12:46:40.000 INFO:teuthology.orchestra.run.smithi092.stderr: 17100K .......... .......... .......... .......... .......... 18% 116M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17150K .......... .......... .......... .......... .......... 18% 89.0M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17200K .......... .......... .......... .......... .......... 18% 90.1M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17250K .......... .......... .......... .......... .......... 18% 150M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17300K .......... .......... .......... .......... .......... 18% 117M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17350K .......... .......... .......... .......... .......... 18% 112M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17400K .......... .......... .......... .......... .......... 18% 119M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17450K .......... .......... .......... .......... .......... 18% 116M 1s 2020-04-28T12:46:40.001 INFO:teuthology.orchestra.run.smithi092.stderr: 17500K .......... .......... .......... .......... .......... 18% 113M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17550K .......... .......... .......... .......... .......... 18% 73.6M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17600K .......... .......... .......... .......... .......... 18% 147M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17650K .......... .......... .......... .......... .......... 19% 116M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17700K .......... .......... .......... .......... .......... 19% 117M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17750K .......... .......... .......... .......... .......... 19% 117M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17800K .......... .......... .......... .......... .......... 19% 109M 1s 2020-04-28T12:46:40.002 INFO:teuthology.orchestra.run.smithi092.stderr: 17850K .......... .......... .......... .......... .......... 19% 125M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 17900K .......... .......... .......... .......... .......... 19% 117M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 17950K .......... .......... .......... .......... .......... 19% 89.3M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 18000K .......... .......... .......... .......... .......... 19% 115M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 18050K .......... .......... .......... .......... .......... 19% 118M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 18100K .......... .......... .......... .......... .......... 19% 111M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 18150K .......... .......... .......... .......... .......... 19% 85.2M 1s 2020-04-28T12:46:40.003 INFO:teuthology.orchestra.run.smithi092.stderr: 18200K .......... .......... .......... .......... .......... 19% 107M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18250K .......... .......... .......... .......... .......... 19% 84.8M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18300K .......... .......... .......... .......... .......... 19% 108M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18350K .......... .......... .......... .......... .......... 19% 87.0M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18400K .......... .......... .......... .......... .......... 19% 93.1M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18450K .......... .......... .......... .......... .......... 19% 115M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18500K .......... .......... .......... .......... .......... 19% 65.7M 1s 2020-04-28T12:46:40.004 INFO:teuthology.orchestra.run.smithi092.stderr: 18550K .......... .......... .......... .......... .......... 20% 111M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18600K .......... .......... .......... .......... .......... 20% 107M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18650K .......... .......... .......... .......... .......... 20% 114M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18700K .......... .......... .......... .......... .......... 20% 116M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18750K .......... .......... .......... .......... .......... 20% 89.9M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18800K .......... .......... .......... .......... .......... 20% 120M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18850K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:46:40.005 INFO:teuthology.orchestra.run.smithi092.stderr: 18900K .......... .......... .......... .......... .......... 20% 110M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 18950K .......... .......... .......... .......... .......... 20% 110M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19000K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19050K .......... .......... .......... .......... .......... 20% 73.6M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19100K .......... .......... .......... .......... .......... 20% 93.6M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19150K .......... .......... .......... .......... .......... 20% 72.4M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19200K .......... .......... .......... .......... .......... 20% 115M 1s 2020-04-28T12:46:40.006 INFO:teuthology.orchestra.run.smithi092.stderr: 19250K .......... .......... .......... .......... .......... 20% 115M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19300K .......... .......... .......... .......... .......... 20% 115M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19350K .......... .......... .......... .......... .......... 20% 113M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19400K .......... .......... .......... .......... .......... 20% 104M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19450K .......... .......... .......... .......... .......... 20% 101M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19500K .......... .......... .......... .......... .......... 21% 112M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19550K .......... .......... .......... .......... .......... 21% 63.1M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19600K .......... .......... .......... .......... .......... 21% 94.5M 1s 2020-04-28T12:46:40.007 INFO:teuthology.orchestra.run.smithi092.stderr: 19650K .......... .......... .......... .......... .......... 21% 79.4M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19700K .......... .......... .......... .......... .......... 21% 110M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19750K .......... .......... .......... .......... .......... 21% 110M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19800K .......... .......... .......... .......... .......... 21% 67.8M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19850K .......... .......... .......... .......... .......... 21% 119M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19900K .......... .......... .......... .......... .......... 21% 112M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 19950K .......... .......... .......... .......... .......... 21% 80.4M 1s 2020-04-28T12:46:40.008 INFO:teuthology.orchestra.run.smithi092.stderr: 20000K .......... .......... .......... .......... .......... 21% 85.4M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20050K .......... .......... .......... .......... .......... 21% 62.8M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20100K .......... .......... .......... .......... .......... 21% 103M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20150K .......... .......... .......... .......... .......... 21% 110M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20200K .......... .......... .......... .......... .......... 21% 73.7M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20250K .......... .......... .......... .......... .......... 21% 75.6M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20300K .......... .......... .......... .......... .......... 21% 61.2M 1s 2020-04-28T12:46:40.009 INFO:teuthology.orchestra.run.smithi092.stderr: 20350K .......... .......... .......... .......... .......... 21% 74.6M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20400K .......... .......... .......... .......... .......... 22% 62.3M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20450K .......... .......... .......... .......... .......... 22% 101M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20500K .......... .......... .......... .......... .......... 22% 68.0M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20550K .......... .......... .......... .......... .......... 22% 69.5M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20600K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20650K .......... .......... .......... .......... .......... 22% 119M 1s 2020-04-28T12:46:40.010 INFO:teuthology.orchestra.run.smithi092.stderr: 20700K .......... .......... .......... .......... .......... 22% 91.3M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 20750K .......... .......... .......... .......... .......... 22% 88.5M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 20800K .......... .......... .......... .......... .......... 22% 97.3M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 20850K .......... .......... .......... .......... .......... 22% 104M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 20900K .......... .......... .......... .......... .......... 22% 111M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 20950K .......... .......... .......... .......... .......... 22% 67.1M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 21000K .......... .......... .......... .......... .......... 22% 87.9M 1s 2020-04-28T12:46:40.011 INFO:teuthology.orchestra.run.smithi092.stderr: 21050K .......... .......... .......... .......... .......... 22% 91.8M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21100K .......... .......... .......... .......... .......... 22% 72.1M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21150K .......... .......... .......... .......... .......... 22% 74.7M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21200K .......... .......... .......... .......... .......... 22% 119M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21250K .......... .......... .......... .......... .......... 22% 94.5M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21300K .......... .......... .......... .......... .......... 22% 117M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21350K .......... .......... .......... .......... .......... 23% 112M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21400K .......... .......... .......... .......... .......... 23% 113M 1s 2020-04-28T12:46:40.012 INFO:teuthology.orchestra.run.smithi092.stderr: 21450K .......... .......... .......... .......... .......... 23% 127M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21500K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21550K .......... .......... .......... .......... .......... 23% 90.0M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21600K .......... .......... .......... .......... .......... 23% 118M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21650K .......... .......... .......... .......... .......... 23% 120M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21700K .......... .......... .......... .......... .......... 23% 115M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21750K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:46:40.013 INFO:teuthology.orchestra.run.smithi092.stderr: 21800K .......... .......... .......... .......... .......... 23% 109M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 21850K .......... .......... .......... .......... .......... 23% 107M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 21900K .......... .......... .......... .......... .......... 23% 132M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 21950K .......... .......... .......... .......... .......... 23% 87.8M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 22000K .......... .......... .......... .......... .......... 23% 120M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 22050K .......... .......... .......... .......... .......... 23% 116M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 22100K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:46:40.014 INFO:teuthology.orchestra.run.smithi092.stderr: 22150K .......... .......... .......... .......... .......... 23% 118M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22200K .......... .......... .......... .......... .......... 23% 86.1M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22250K .......... .......... .......... .......... .......... 24% 93.1M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22300K .......... .......... .......... .......... .......... 24% 115M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22350K .......... .......... .......... .......... .......... 24% 86.1M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22400K .......... .......... .......... .......... .......... 24% 124M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22450K .......... .......... .......... .......... .......... 24% 106M 1s 2020-04-28T12:46:40.015 INFO:teuthology.orchestra.run.smithi092.stderr: 22500K .......... .......... .......... .......... .......... 24% 125M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22550K .......... .......... .......... .......... .......... 24% 101M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22600K .......... .......... .......... .......... .......... 24% 108M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22650K .......... .......... .......... .......... .......... 24% 119M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22700K .......... .......... .......... .......... .......... 24% 91.9M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22750K .......... .......... .......... .......... .......... 24% 79.3M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22800K .......... .......... .......... .......... .......... 24% 97.5M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22850K .......... .......... .......... .......... .......... 24% 122M 1s 2020-04-28T12:46:40.016 INFO:teuthology.orchestra.run.smithi092.stderr: 22900K .......... .......... .......... .......... .......... 24% 117M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 22950K .......... .......... .......... .......... .......... 24% 111M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23000K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23050K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23100K .......... .......... .......... .......... .......... 24% 120M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23150K .......... .......... .......... .......... .......... 24% 86.4M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23200K .......... .......... .......... .......... .......... 25% 93.3M 1s 2020-04-28T12:46:40.017 INFO:teuthology.orchestra.run.smithi092.stderr: 23250K .......... .......... .......... .......... .......... 25% 113M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23300K .......... .......... .......... .......... .......... 25% 109M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23350K .......... .......... .......... .......... .......... 25% 107M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23400K .......... .......... .......... .......... .......... 25% 126M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23450K .......... .......... .......... .......... .......... 25% 114M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23500K .......... .......... .......... .......... .......... 25% 109M 1s 2020-04-28T12:46:40.018 INFO:teuthology.orchestra.run.smithi092.stderr: 23550K .......... .......... .......... .......... .......... 25% 92.0M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23600K .......... .......... .......... .......... .......... 25% 101M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23650K .......... .......... .......... .......... .......... 25% 101M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23700K .......... .......... .......... .......... .......... 25% 78.5M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23750K .......... .......... .......... .......... .......... 25% 97.1M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23800K .......... .......... .......... .......... .......... 25% 74.6M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23850K .......... .......... .......... .......... .......... 25% 122M 1s 2020-04-28T12:46:40.019 INFO:teuthology.orchestra.run.smithi092.stderr: 23900K .......... .......... .......... .......... .......... 25% 86.2M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 23950K .......... .......... .......... .......... .......... 25% 75.3M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24000K .......... .......... .......... .......... .......... 25% 68.7M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24050K .......... .......... .......... .......... .......... 25% 95.3M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24100K .......... .......... .......... .......... .......... 25% 106M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24150K .......... .......... .......... .......... .......... 26% 63.2M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24200K .......... .......... .......... .......... .......... 26% 77.2M 1s 2020-04-28T12:46:40.020 INFO:teuthology.orchestra.run.smithi092.stderr: 24250K .......... .......... .......... .......... .......... 26% 74.4M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24300K .......... .......... .......... .......... .......... 26% 109M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24350K .......... .......... .......... .......... .......... 26% 96.2M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24400K .......... .......... .......... .......... .......... 26% 62.9M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24450K .......... .......... .......... .......... .......... 26% 102M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24500K .......... .......... .......... .......... .......... 26% 86.1M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24550K .......... .......... .......... .......... .......... 26% 97.9M 1s 2020-04-28T12:46:40.021 INFO:teuthology.orchestra.run.smithi092.stderr: 24600K .......... .......... .......... .......... .......... 26% 104M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24650K .......... .......... .......... .......... .......... 26% 56.2M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24700K .......... .......... .......... .......... .......... 26% 109M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24750K .......... .......... .......... .......... .......... 26% 85.3M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24800K .......... .......... .......... .......... .......... 26% 66.2M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24850K .......... .......... .......... .......... .......... 26% 112M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24900K .......... .......... .......... .......... .......... 26% 68.8M 1s 2020-04-28T12:46:40.022 INFO:teuthology.orchestra.run.smithi092.stderr: 24950K .......... .......... .......... .......... .......... 26% 72.7M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25000K .......... .......... .......... .......... .......... 26% 58.9M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25050K .......... .......... .......... .......... .......... 27% 118M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25100K .......... .......... .......... .......... .......... 27% 98.5M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25150K .......... .......... .......... .......... .......... 27% 72.6M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25200K .......... .......... .......... .......... .......... 27% 67.5M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25250K .......... .......... .......... .......... .......... 27% 72.6M 1s 2020-04-28T12:46:40.023 INFO:teuthology.orchestra.run.smithi092.stderr: 25300K .......... .......... .......... .......... .......... 27% 87.0M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25350K .......... .......... .......... .......... .......... 27% 120M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25400K .......... .......... .......... .......... .......... 27% 68.3M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25450K .......... .......... .......... .......... .......... 27% 114M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25500K .......... .......... .......... .......... .......... 27% 96.5M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25550K .......... .......... .......... .......... .......... 27% 92.8M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25600K .......... .......... .......... .......... .......... 27% 114M 1s 2020-04-28T12:46:40.024 INFO:teuthology.orchestra.run.smithi092.stderr: 25650K .......... .......... .......... .......... .......... 27% 104M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25700K .......... .......... .......... .......... .......... 27% 96.1M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25750K .......... .......... .......... .......... .......... 27% 113M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25800K .......... .......... .......... .......... .......... 27% 103M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25850K .......... .......... .......... .......... .......... 27% 50.9M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25900K .......... .......... .......... .......... .......... 27% 52.7M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 25950K .......... .......... .......... .......... .......... 27% 84.5M 1s 2020-04-28T12:46:40.025 INFO:teuthology.orchestra.run.smithi092.stderr: 26000K .......... .......... .......... .......... .......... 28% 112M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26050K .......... .......... .......... .......... .......... 28% 114M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26100K .......... .......... .......... .......... .......... 28% 120M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26150K .......... .......... .......... .......... .......... 28% 104M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26200K .......... .......... .......... .......... .......... 28% 116M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26250K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26300K .......... .......... .......... .......... .......... 28% 118M 1s 2020-04-28T12:46:40.026 INFO:teuthology.orchestra.run.smithi092.stderr: 26350K .......... .......... .......... .......... .......... 28% 76.3M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26400K .......... .......... .......... .......... .......... 28% 107M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26450K .......... .......... .......... .......... .......... 28% 108M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26500K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26550K .......... .......... .......... .......... .......... 28% 104M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26600K .......... .......... .......... .......... .......... 28% 124M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26650K .......... .......... .......... .......... .......... 28% 118M 1s 2020-04-28T12:46:40.027 INFO:teuthology.orchestra.run.smithi092.stderr: 26700K .......... .......... .......... .......... .......... 28% 110M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 26750K .......... .......... .......... .......... .......... 28% 93.4M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 26800K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 26850K .......... .......... .......... .......... .......... 28% 116M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 26900K .......... .......... .......... .......... .......... 29% 101M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 26950K .......... .......... .......... .......... .......... 29% 74.6M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 27000K .......... .......... .......... .......... .......... 29% 107M 1s 2020-04-28T12:46:40.028 INFO:teuthology.orchestra.run.smithi092.stderr: 27050K .......... .......... .......... .......... .......... 29% 121M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27100K .......... .......... .......... .......... .......... 29% 120M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27150K .......... .......... .......... .......... .......... 29% 89.5M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27200K .......... .......... .......... .......... .......... 29% 120M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27250K .......... .......... .......... .......... .......... 29% 96.6M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27300K .......... .......... .......... .......... .......... 29% 110M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27350K .......... .......... .......... .......... .......... 29% 106M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27400K .......... .......... .......... .......... .......... 29% 126M 1s 2020-04-28T12:46:40.029 INFO:teuthology.orchestra.run.smithi092.stderr: 27450K .......... .......... .......... .......... .......... 29% 116M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27500K .......... .......... .......... .......... .......... 29% 118M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27550K .......... .......... .......... .......... .......... 29% 90.0M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27600K .......... .......... .......... .......... .......... 29% 115M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27650K .......... .......... .......... .......... .......... 29% 113M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27700K .......... .......... .......... .......... .......... 29% 109M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27750K .......... .......... .......... .......... .......... 29% 119M 1s 2020-04-28T12:46:40.030 INFO:teuthology.orchestra.run.smithi092.stderr: 27800K .......... .......... .......... .......... .......... 29% 115M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 27850K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 27900K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 27950K .......... .......... .......... .......... .......... 30% 68.1M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 28000K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 28050K .......... .......... .......... .......... .......... 30% 117M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 28100K .......... .......... .......... .......... .......... 30% 116M 1s 2020-04-28T12:46:40.031 INFO:teuthology.orchestra.run.smithi092.stderr: 28150K .......... .......... .......... .......... .......... 30% 95.3M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28200K .......... .......... .......... .......... .......... 30% 70.5M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28250K .......... .......... .......... .......... .......... 30% 111M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28300K .......... .......... .......... .......... .......... 30% 69.7M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28350K .......... .......... .......... .......... .......... 30% 59.7M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28400K .......... .......... .......... .......... .......... 30% 99.3M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28450K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:46:40.032 INFO:teuthology.orchestra.run.smithi092.stderr: 28500K .......... .......... .......... .......... .......... 30% 120M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28550K .......... .......... .......... .......... .......... 30% 94.5M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28600K .......... .......... .......... .......... .......... 30% 102M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28650K .......... .......... .......... .......... .......... 30% 87.6M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28700K .......... .......... .......... .......... .......... 30% 88.6M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28750K .......... .......... .......... .......... .......... 31% 55.7M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28800K .......... .......... .......... .......... .......... 31% 116M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28850K .......... .......... .......... .......... .......... 31% 67.7M 1s 2020-04-28T12:46:40.033 INFO:teuthology.orchestra.run.smithi092.stderr: 28900K .......... .......... .......... .......... .......... 31% 57.4M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 28950K .......... .......... .......... .......... .......... 31% 103M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29000K .......... .......... .......... .......... .......... 31% 115M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29050K .......... .......... .......... .......... .......... 31% 110M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29100K .......... .......... .......... .......... .......... 31% 106M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29150K .......... .......... .......... .......... .......... 31% 102M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29200K .......... .......... .......... .......... .......... 31% 115M 1s 2020-04-28T12:46:40.034 INFO:teuthology.orchestra.run.smithi092.stderr: 29250K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29300K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29350K .......... .......... .......... .......... .......... 31% 109M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29400K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29450K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29500K .......... .......... .......... .......... .......... 31% 99.7M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29550K .......... .......... .......... .......... .......... 31% 59.4M 1s 2020-04-28T12:46:40.035 INFO:teuthology.orchestra.run.smithi092.stderr: 29600K .......... .......... .......... .......... .......... 31% 73.7M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29650K .......... .......... .......... .......... .......... 31% 72.5M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29700K .......... .......... .......... .......... .......... 32% 110M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29750K .......... .......... .......... .......... .......... 32% 115M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29800K .......... .......... .......... .......... .......... 32% 63.6M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29850K .......... .......... .......... .......... .......... 32% 83.5M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29900K .......... .......... .......... .......... .......... 32% 71.9M 1s 2020-04-28T12:46:40.036 INFO:teuthology.orchestra.run.smithi092.stderr: 29950K .......... .......... .......... .......... .......... 32% 82.4M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30000K .......... .......... .......... .......... .......... 32% 113M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30050K .......... .......... .......... .......... .......... 32% 101M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30100K .......... .......... .......... .......... .......... 32% 120M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30150K .......... .......... .......... .......... .......... 32% 112M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30200K .......... .......... .......... .......... .......... 32% 111M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30250K .......... .......... .......... .......... .......... 32% 103M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30300K .......... .......... .......... .......... .......... 32% 57.9M 1s 2020-04-28T12:46:40.037 INFO:teuthology.orchestra.run.smithi092.stderr: 30350K .......... .......... .......... .......... .......... 32% 64.2M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30400K .......... .......... .......... .......... .......... 32% 56.5M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30450K .......... .......... .......... .......... .......... 32% 104M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30500K .......... .......... .......... .......... .......... 32% 124M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30550K .......... .......... .......... .......... .......... 32% 109M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30600K .......... .......... .......... .......... .......... 32% 118M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30650K .......... .......... .......... .......... .......... 33% 114M 1s 2020-04-28T12:46:40.038 INFO:teuthology.orchestra.run.smithi092.stderr: 30700K .......... .......... .......... .......... .......... 33% 114M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 30750K .......... .......... .......... .......... .......... 33% 91.3M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 30800K .......... .......... .......... .......... .......... 33% 117M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 30850K .......... .......... .......... .......... .......... 33% 114M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 30900K .......... .......... .......... .......... .......... 33% 89.8M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 30950K .......... .......... .......... .......... .......... 33% 112M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 31000K .......... .......... .......... .......... .......... 33% 116M 1s 2020-04-28T12:46:40.039 INFO:teuthology.orchestra.run.smithi092.stderr: 31050K .......... .......... .......... .......... .......... 33% 98.3M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31100K .......... .......... .......... .......... .......... 33% 118M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31150K .......... .......... .......... .......... .......... 33% 86.8M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31200K .......... .......... .......... .......... .......... 33% 112M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31250K .......... .......... .......... .......... .......... 33% 117M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31300K .......... .......... .......... .......... .......... 33% 118M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31350K .......... .......... .......... .......... .......... 33% 108M 1s 2020-04-28T12:46:40.040 INFO:teuthology.orchestra.run.smithi092.stderr: 31400K .......... .......... .......... .......... .......... 33% 97.2M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31450K .......... .......... .......... .......... .......... 33% 114M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31500K .......... .......... .......... .......... .......... 33% 113M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31550K .......... .......... .......... .......... .......... 34% 86.8M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31600K .......... .......... .......... .......... .......... 34% 123M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31650K .......... .......... .......... .......... .......... 34% 116M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31700K .......... .......... .......... .......... .......... 34% 116M 1s 2020-04-28T12:46:40.041 INFO:teuthology.orchestra.run.smithi092.stderr: 31750K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 31800K .......... .......... .......... .......... .......... 34% 118M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 31850K .......... .......... .......... .......... .......... 34% 110M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 31900K .......... .......... .......... .......... .......... 34% 121M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 31950K .......... .......... .......... .......... .......... 34% 94.3M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 32000K .......... .......... .......... .......... .......... 34% 106M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 32050K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:46:40.042 INFO:teuthology.orchestra.run.smithi092.stderr: 32100K .......... .......... .......... .......... .......... 34% 117M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32150K .......... .......... .......... .......... .......... 34% 111M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32200K .......... .......... .......... .......... .......... 34% 111M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32250K .......... .......... .......... .......... .......... 34% 114M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32300K .......... .......... .......... .......... .......... 34% 118M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32350K .......... .......... .......... .......... .......... 34% 90.3M 1s 2020-04-28T12:46:40.043 INFO:teuthology.orchestra.run.smithi092.stderr: 32400K .......... .......... .......... .......... .......... 34% 112M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32450K .......... .......... .......... .......... .......... 34% 120M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32500K .......... .......... .......... .......... .......... 35% 123M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32550K .......... .......... .......... .......... .......... 35% 109M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32600K .......... .......... .......... .......... .......... 35% 112M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32650K .......... .......... .......... .......... .......... 35% 119M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32700K .......... .......... .......... .......... .......... 35% 112M 1s 2020-04-28T12:46:40.044 INFO:teuthology.orchestra.run.smithi092.stderr: 32750K .......... .......... .......... .......... .......... 35% 90.5M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 32800K .......... .......... .......... .......... .......... 35% 114M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 32850K .......... .......... .......... .......... .......... 35% 108M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 32900K .......... .......... .......... .......... .......... 35% 80.6M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 32950K .......... .......... .......... .......... .......... 35% 153M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 33000K .......... .......... .......... .......... .......... 35% 138M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 33050K .......... .......... .......... .......... .......... 35% 124M 1s 2020-04-28T12:46:40.045 INFO:teuthology.orchestra.run.smithi092.stderr: 33100K .......... .......... .......... .......... .......... 35% 105M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33150K .......... .......... .......... .......... .......... 35% 93.8M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33200K .......... .......... .......... .......... .......... 35% 106M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33250K .......... .......... .......... .......... .......... 35% 123M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33300K .......... .......... .......... .......... .......... 35% 118M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33350K .......... .......... .......... .......... .......... 35% 114M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33400K .......... .......... .......... .......... .......... 36% 118M 1s 2020-04-28T12:46:40.046 INFO:teuthology.orchestra.run.smithi092.stderr: 33450K .......... .......... .......... .......... .......... 36% 91.9M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33500K .......... .......... .......... .......... .......... 36% 82.1M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33550K .......... .......... .......... .......... .......... 36% 136M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33600K .......... .......... .......... .......... .......... 36% 143M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33650K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33700K .......... .......... .......... .......... .......... 36% 119M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33750K .......... .......... .......... .......... .......... 36% 111M 1s 2020-04-28T12:46:40.047 INFO:teuthology.orchestra.run.smithi092.stderr: 33800K .......... .......... .......... .......... .......... 36% 115M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 33850K .......... .......... .......... .......... .......... 36% 115M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 33900K .......... .......... .......... .......... .......... 36% 106M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 33950K .......... .......... .......... .......... .......... 36% 95.0M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 34000K .......... .......... .......... .......... .......... 36% 106M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 34050K .......... .......... .......... .......... .......... 36% 97.0M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 34100K .......... .......... .......... .......... .......... 36% 96.7M 1s 2020-04-28T12:46:40.048 INFO:teuthology.orchestra.run.smithi092.stderr: 34150K .......... .......... .......... .......... .......... 36% 100M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34200K .......... .......... .......... .......... .......... 36% 96.4M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34250K .......... .......... .......... .......... .......... 36% 110M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34300K .......... .......... .......... .......... .......... 36% 110M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34350K .......... .......... .......... .......... .......... 37% 91.9M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34400K .......... .......... .......... .......... .......... 37% 114M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34450K .......... .......... .......... .......... .......... 37% 92.4M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34500K .......... .......... .......... .......... .......... 37% 125M 1s 2020-04-28T12:46:40.049 INFO:teuthology.orchestra.run.smithi092.stderr: 34550K .......... .......... .......... .......... .......... 37% 97.7M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34600K .......... .......... .......... .......... .......... 37% 75.7M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34650K .......... .......... .......... .......... .......... 37% 220M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34700K .......... .......... .......... .......... .......... 37% 106M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34750K .......... .......... .......... .......... .......... 37% 91.6M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34800K .......... .......... .......... .......... .......... 37% 70.4M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34850K .......... .......... .......... .......... .......... 37% 40.3M 1s 2020-04-28T12:46:40.050 INFO:teuthology.orchestra.run.smithi092.stderr: 34900K .......... .......... .......... .......... .......... 37% 55.5M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 34950K .......... .......... .......... .......... .......... 37% 71.1M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35000K .......... .......... .......... .......... .......... 37% 100M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35050K .......... .......... .......... .......... .......... 37% 69.9M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35100K .......... .......... .......... .......... .......... 37% 87.9M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35150K .......... .......... .......... .......... .......... 37% 50.7M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35200K .......... .......... .......... .......... .......... 37% 79.2M 1s 2020-04-28T12:46:40.051 INFO:teuthology.orchestra.run.smithi092.stderr: 35250K .......... .......... .......... .......... .......... 37% 64.9M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35300K .......... .......... .......... .......... .......... 38% 117M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35350K .......... .......... .......... .......... .......... 38% 107M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35400K .......... .......... .......... .......... .......... 38% 104M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35450K .......... .......... .......... .......... .......... 38% 119M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35500K .......... .......... .......... .......... .......... 38% 117M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35550K .......... .......... .......... .......... .......... 38% 87.7M 1s 2020-04-28T12:46:40.052 INFO:teuthology.orchestra.run.smithi092.stderr: 35600K .......... .......... .......... .......... .......... 38% 71.3M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35650K .......... .......... .......... .......... .......... 38% 115M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35700K .......... .......... .......... .......... .......... 38% 112M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35750K .......... .......... .......... .......... .......... 38% 89.1M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35800K .......... .......... .......... .......... .......... 38% 125M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35850K .......... .......... .......... .......... .......... 38% 96.0M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35900K .......... .......... .......... .......... .......... 38% 85.4M 1s 2020-04-28T12:46:40.053 INFO:teuthology.orchestra.run.smithi092.stderr: 35950K .......... .......... .......... .......... .......... 38% 89.0M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36000K .......... .......... .......... .......... .......... 38% 113M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36050K .......... .......... .......... .......... .......... 38% 86.6M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36100K .......... .......... .......... .......... .......... 38% 120M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36150K .......... .......... .......... .......... .......... 38% 102M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36200K .......... .......... .......... .......... .......... 39% 103M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36250K .......... .......... .......... .......... .......... 39% 114M 1s 2020-04-28T12:46:40.054 INFO:teuthology.orchestra.run.smithi092.stderr: 36300K .......... .......... .......... .......... .......... 39% 115M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36350K .......... .......... .......... .......... .......... 39% 90.2M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36400K .......... .......... .......... .......... .......... 39% 107M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36450K .......... .......... .......... .......... .......... 39% 129M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36500K .......... .......... .......... .......... .......... 39% 91.4M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36550K .......... .......... .......... .......... .......... 39% 88.1M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36600K .......... .......... .......... .......... .......... 39% 106M 1s 2020-04-28T12:46:40.055 INFO:teuthology.orchestra.run.smithi092.stderr: 36650K .......... .......... .......... .......... .......... 39% 98.4M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36700K .......... .......... .......... .......... .......... 39% 126M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36750K .......... .......... .......... .......... .......... 39% 96.7M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36800K .......... .......... .......... .......... .......... 39% 89.3M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36850K .......... .......... .......... .......... .......... 39% 180M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36900K .......... .......... .......... .......... .......... 39% 107M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 36950K .......... .......... .......... .......... .......... 39% 123M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 37000K .......... .......... .......... .......... .......... 39% 109M 1s 2020-04-28T12:46:40.056 INFO:teuthology.orchestra.run.smithi092.stderr: 37050K .......... .......... .......... .......... .......... 39% 114M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37100K .......... .......... .......... .......... .......... 39% 106M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37150K .......... .......... .......... .......... .......... 40% 68.6M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37200K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37250K .......... .......... .......... .......... .......... 40% 90.2M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37300K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37350K .......... .......... .......... .......... .......... 40% 114M 1s 2020-04-28T12:46:40.057 INFO:teuthology.orchestra.run.smithi092.stderr: 37400K .......... .......... .......... .......... .......... 40% 112M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37450K .......... .......... .......... .......... .......... 40% 117M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37500K .......... .......... .......... .......... .......... 40% 103M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37550K .......... .......... .......... .......... .......... 40% 82.8M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37600K .......... .......... .......... .......... .......... 40% 122M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37650K .......... .......... .......... .......... .......... 40% 111M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37700K .......... .......... .......... .......... .......... 40% 124M 1s 2020-04-28T12:46:40.058 INFO:teuthology.orchestra.run.smithi092.stderr: 37750K .......... .......... .......... .......... .......... 40% 108M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 37800K .......... .......... .......... .......... .......... 40% 114M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 37850K .......... .......... .......... .......... .......... 40% 122M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 37900K .......... .......... .......... .......... .......... 40% 115M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 37950K .......... .......... .......... .......... .......... 40% 86.0M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 38000K .......... .......... .......... .......... .......... 40% 98.9M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 38050K .......... .......... .......... .......... .......... 41% 129M 1s 2020-04-28T12:46:40.059 INFO:teuthology.orchestra.run.smithi092.stderr: 38100K .......... .......... .......... .......... .......... 41% 118M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38150K .......... .......... .......... .......... .......... 41% 111M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38200K .......... .......... .......... .......... .......... 41% 104M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38250K .......... .......... .......... .......... .......... 41% 107M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38300K .......... .......... .......... .......... .......... 41% 112M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38350K .......... .......... .......... .......... .......... 41% 92.8M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38400K .......... .......... .......... .......... .......... 41% 116M 1s 2020-04-28T12:46:40.060 INFO:teuthology.orchestra.run.smithi092.stderr: 38450K .......... .......... .......... .......... .......... 41% 105M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38500K .......... .......... .......... .......... .......... 41% 105M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38550K .......... .......... .......... .......... .......... 41% 104M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38600K .......... .......... .......... .......... .......... 41% 118M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38650K .......... .......... .......... .......... .......... 41% 114M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38700K .......... .......... .......... .......... .......... 41% 92.0M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38750K .......... .......... .......... .......... .......... 41% 84.1M 1s 2020-04-28T12:46:40.061 INFO:teuthology.orchestra.run.smithi092.stderr: 38800K .......... .......... .......... .......... .......... 41% 112M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 38850K .......... .......... .......... .......... .......... 41% 108M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 38900K .......... .......... .......... .......... .......... 41% 101M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 38950K .......... .......... .......... .......... .......... 41% 111M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 39000K .......... .......... .......... .......... .......... 42% 107M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 39050K .......... .......... .......... .......... .......... 42% 129M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 39100K .......... .......... .......... .......... .......... 42% 96.3M 1s 2020-04-28T12:46:40.062 INFO:teuthology.orchestra.run.smithi092.stderr: 39150K .......... .......... .......... .......... .......... 42% 88.9M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39200K .......... .......... .......... .......... .......... 42% 134M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39250K .......... .......... .......... .......... .......... 42% 95.7M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39300K .......... .......... .......... .......... .......... 42% 126M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39350K .......... .......... .......... .......... .......... 42% 121M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39400K .......... .......... .......... .......... .......... 42% 95.0M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39450K .......... .......... .......... .......... .......... 42% 58.2M 1s 2020-04-28T12:46:40.063 INFO:teuthology.orchestra.run.smithi092.stderr: 39500K .......... .......... .......... .......... .......... 42% 58.9M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39550K .......... .......... .......... .......... .......... 42% 47.6M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39600K .......... .......... .......... .......... .......... 42% 76.4M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39650K .......... .......... .......... .......... .......... 42% 81.0M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39700K .......... .......... .......... .......... .......... 42% 86.3M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39750K .......... .......... .......... .......... .......... 42% 99.5M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39800K .......... .......... .......... .......... .......... 42% 99.4M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39850K .......... .......... .......... .......... .......... 42% 67.0M 1s 2020-04-28T12:46:40.064 INFO:teuthology.orchestra.run.smithi092.stderr: 39900K .......... .......... .......... .......... .......... 43% 82.5M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 39950K .......... .......... .......... .......... .......... 43% 69.6M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40000K .......... .......... .......... .......... .......... 43% 95.2M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40050K .......... .......... .......... .......... .......... 43% 79.0M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40100K .......... .......... .......... .......... .......... 43% 77.2M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40150K .......... .......... .......... .......... .......... 43% 72.7M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40200K .......... .......... .......... .......... .......... 43% 108M 1s 2020-04-28T12:46:40.065 INFO:teuthology.orchestra.run.smithi092.stderr: 40250K .......... .......... .......... .......... .......... 43% 121M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40300K .......... .......... .......... .......... .......... 43% 116M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40350K .......... .......... .......... .......... .......... 43% 85.0M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40400K .......... .......... .......... .......... .......... 43% 121M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40450K .......... .......... .......... .......... .......... 43% 113M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40500K .......... .......... .......... .......... .......... 43% 115M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40550K .......... .......... .......... .......... .......... 43% 109M 1s 2020-04-28T12:46:40.066 INFO:teuthology.orchestra.run.smithi092.stderr: 40600K .......... .......... .......... .......... .......... 43% 110M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40650K .......... .......... .......... .......... .......... 43% 95.6M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40700K .......... .......... .......... .......... .......... 43% 96.9M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40750K .......... .......... .......... .......... .......... 43% 64.9M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40800K .......... .......... .......... .......... .......... 43% 97.2M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40850K .......... .......... .......... .......... .......... 44% 123M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40900K .......... .......... .......... .......... .......... 44% 116M 1s 2020-04-28T12:46:40.067 INFO:teuthology.orchestra.run.smithi092.stderr: 40950K .......... .......... .......... .......... .......... 44% 105M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41000K .......... .......... .......... .......... .......... 44% 120M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41050K .......... .......... .......... .......... .......... 44% 111M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41100K .......... .......... .......... .......... .......... 44% 116M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41150K .......... .......... .......... .......... .......... 44% 85.4M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41200K .......... .......... .......... .......... .......... 44% 124M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41250K .......... .......... .......... .......... .......... 44% 113M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41300K .......... .......... .......... .......... .......... 44% 118M 1s 2020-04-28T12:46:40.068 INFO:teuthology.orchestra.run.smithi092.stderr: 41350K .......... .......... .......... .......... .......... 44% 108M 1s 2020-04-28T12:46:40.069 INFO:teuthology.orchestra.run.smithi092.stderr: 41400K .......... .......... .......... .......... .......... 44% 118M 1s 2020-04-28T12:46:40.069 INFO:teuthology.orchestra.run.smithi092.stderr: 41450K .......... .......... .......... .......... .......... 44% 114M 1s 2020-04-28T12:46:40.069 INFO:teuthology.orchestra.run.smithi092.stderr: 41500K .......... .......... .......... .......... .......... 44% 109M 1s 2020-04-28T12:46:40.069 INFO:teuthology.orchestra.run.smithi092.stderr: 41550K .......... .......... .......... .......... .......... 44% 88.7M 1s 2020-04-28T12:46:40.069 INFO:teuthology.orchestra.run.smithi092.stderr: 41600K .......... .......... .......... .......... .......... 44% 125M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41650K .......... .......... .......... .......... .......... 44% 72.5M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41700K .......... .......... .......... .......... .......... 44% 108M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41750K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41800K .......... .......... .......... .......... .......... 45% 98.3M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41850K .......... .......... .......... .......... .......... 45% 106M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41900K .......... .......... .......... .......... .......... 45% 101M 1s 2020-04-28T12:46:40.070 INFO:teuthology.orchestra.run.smithi092.stderr: 41950K .......... .......... .......... .......... .......... 45% 102M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42000K .......... .......... .......... .......... .......... 45% 111M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42050K .......... .......... .......... .......... .......... 45% 125M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42100K .......... .......... .......... .......... .......... 45% 116M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42150K .......... .......... .......... .......... .......... 45% 111M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42200K .......... .......... .......... .......... .......... 45% 112M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42250K .......... .......... .......... .......... .......... 45% 120M 1s 2020-04-28T12:46:40.071 INFO:teuthology.orchestra.run.smithi092.stderr: 42300K .......... .......... .......... .......... .......... 45% 119M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42350K .......... .......... .......... .......... .......... 45% 89.2M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42400K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42450K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42500K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42550K .......... .......... .......... .......... .......... 45% 112M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42600K .......... .......... .......... .......... .......... 45% 121M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42650K .......... .......... .......... .......... .......... 45% 113M 1s 2020-04-28T12:46:40.072 INFO:teuthology.orchestra.run.smithi092.stderr: 42700K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 42750K .......... .......... .......... .......... .......... 46% 87.3M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 42800K .......... .......... .......... .......... .......... 46% 116M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 42850K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 42900K .......... .......... .......... .......... .......... 46% 115M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 42950K .......... .......... .......... .......... .......... 46% 109M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 43000K .......... .......... .......... .......... .......... 46% 112M 1s 2020-04-28T12:46:40.073 INFO:teuthology.orchestra.run.smithi092.stderr: 43050K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43100K .......... .......... .......... .......... .......... 46% 110M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43150K .......... .......... .......... .......... .......... 46% 89.0M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43200K .......... .......... .......... .......... .......... 46% 110M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43250K .......... .......... .......... .......... .......... 46% 125M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43300K .......... .......... .......... .......... .......... 46% 116M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43350K .......... .......... .......... .......... .......... 46% 97.8M 1s 2020-04-28T12:46:40.074 INFO:teuthology.orchestra.run.smithi092.stderr: 43400K .......... .......... .......... .......... .......... 46% 114M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43450K .......... .......... .......... .......... .......... 46% 109M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43500K .......... .......... .......... .......... .......... 46% 115M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43550K .......... .......... .......... .......... .......... 46% 89.2M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43600K .......... .......... .......... .......... .......... 46% 115M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43650K .......... .......... .......... .......... .......... 47% 114M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43700K .......... .......... .......... .......... .......... 47% 122M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43750K .......... .......... .......... .......... .......... 47% 107M 1s 2020-04-28T12:46:40.075 INFO:teuthology.orchestra.run.smithi092.stderr: 43800K .......... .......... .......... .......... .......... 47% 117M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 43850K .......... .......... .......... .......... .......... 47% 114M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 43900K .......... .......... .......... .......... .......... 47% 99.7M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 43950K .......... .......... .......... .......... .......... 47% 47.2M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 44000K .......... .......... .......... .......... .......... 47% 122M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 44050K .......... .......... .......... .......... .......... 47% 66.6M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 44100K .......... .......... .......... .......... .......... 47% 69.5M 1s 2020-04-28T12:46:40.076 INFO:teuthology.orchestra.run.smithi092.stderr: 44150K .......... .......... .......... .......... .......... 47% 56.5M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44200K .......... .......... .......... .......... .......... 47% 110M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44250K .......... .......... .......... .......... .......... 47% 81.6M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44300K .......... .......... .......... .......... .......... 47% 69.0M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44350K .......... .......... .......... .......... .......... 47% 81.0M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44400K .......... .......... .......... .......... .......... 47% 117M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44450K .......... .......... .......... .......... .......... 47% 108M 1s 2020-04-28T12:46:40.077 INFO:teuthology.orchestra.run.smithi092.stderr: 44500K .......... .......... .......... .......... .......... 47% 57.1M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44550K .......... .......... .......... .......... .......... 48% 111M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44600K .......... .......... .......... .......... .......... 48% 74.8M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44650K .......... .......... .......... .......... .......... 48% 119M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44700K .......... .......... .......... .......... .......... 48% 86.8M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44750K .......... .......... .......... .......... .......... 48% 53.7M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44800K .......... .......... .......... .......... .......... 48% 81.1M 1s 2020-04-28T12:46:40.078 INFO:teuthology.orchestra.run.smithi092.stderr: 44850K .......... .......... .......... .......... .......... 48% 104M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 44900K .......... .......... .......... .......... .......... 48% 129M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 44950K .......... .......... .......... .......... .......... 48% 112M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 45000K .......... .......... .......... .......... .......... 48% 115M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 45050K .......... .......... .......... .......... .......... 48% 115M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 45100K .......... .......... .......... .......... .......... 48% 118M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 45150K .......... .......... .......... .......... .......... 48% 90.7M 1s 2020-04-28T12:46:40.079 INFO:teuthology.orchestra.run.smithi092.stderr: 45200K .......... .......... .......... .......... .......... 48% 115M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45250K .......... .......... .......... .......... .......... 48% 118M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45300K .......... .......... .......... .......... .......... 48% 113M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45350K .......... .......... .......... .......... .......... 48% 106M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45400K .......... .......... .......... .......... .......... 48% 125M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45450K .......... .......... .......... .......... .......... 48% 117M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45500K .......... .......... .......... .......... .......... 49% 117M 1s 2020-04-28T12:46:40.080 INFO:teuthology.orchestra.run.smithi092.stderr: 45550K .......... .......... .......... .......... .......... 49% 88.5M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45600K .......... .......... .......... .......... .......... 49% 116M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45650K .......... .......... .......... .......... .......... 49% 115M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45700K .......... .......... .......... .......... .......... 49% 118M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45750K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45800K .......... .......... .......... .......... .......... 49% 118M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45850K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45900K .......... .......... .......... .......... .......... 49% 114M 1s 2020-04-28T12:46:40.081 INFO:teuthology.orchestra.run.smithi092.stderr: 45950K .......... .......... .......... .......... .......... 49% 75.9M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46000K .......... .......... .......... .......... .......... 49% 107M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46050K .......... .......... .......... .......... .......... 49% 101M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46100K .......... .......... .......... .......... .......... 49% 117M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46150K .......... .......... .......... .......... .......... 49% 110M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46200K .......... .......... .......... .......... .......... 49% 120M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46250K .......... .......... .......... .......... .......... 49% 108M 1s 2020-04-28T12:46:40.082 INFO:teuthology.orchestra.run.smithi092.stderr: 46300K .......... .......... .......... .......... .......... 49% 117M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46350K .......... .......... .......... .......... .......... 49% 84.8M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46400K .......... .......... .......... .......... .......... 49% 107M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46450K .......... .......... .......... .......... .......... 50% 117M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46500K .......... .......... .......... .......... .......... 50% 109M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46550K .......... .......... .......... .......... .......... 50% 113M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46600K .......... .......... .......... .......... .......... 50% 120M 1s 2020-04-28T12:46:40.083 INFO:teuthology.orchestra.run.smithi092.stderr: 46650K .......... .......... .......... .......... .......... 50% 120M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46700K .......... .......... .......... .......... .......... 50% 87.8M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46750K .......... .......... .......... .......... .......... 50% 78.4M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46800K .......... .......... .......... .......... .......... 50% 126M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46850K .......... .......... .......... .......... .......... 50% 109M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46900K .......... .......... .......... .......... .......... 50% 126M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 46950K .......... .......... .......... .......... .......... 50% 77.9M 1s 2020-04-28T12:46:40.084 INFO:teuthology.orchestra.run.smithi092.stderr: 47000K .......... .......... .......... .......... .......... 50% 59.2M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47050K .......... .......... .......... .......... .......... 50% 214M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47100K .......... .......... .......... .......... .......... 50% 219M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47150K .......... .......... .......... .......... .......... 50% 137M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47200K .......... .......... .......... .......... .......... 50% 115M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47250K .......... .......... .......... .......... .......... 50% 114M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47300K .......... .......... .......... .......... .......... 50% 118M 1s 2020-04-28T12:46:40.085 INFO:teuthology.orchestra.run.smithi092.stderr: 47350K .......... .......... .......... .......... .......... 51% 84.3M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47400K .......... .......... .......... .......... .......... 51% 110M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47450K .......... .......... .......... .......... .......... 51% 113M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47500K .......... .......... .......... .......... .......... 51% 114M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47550K .......... .......... .......... .......... .......... 51% 86.1M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47600K .......... .......... .......... .......... .......... 51% 106M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47650K .......... .......... .......... .......... .......... 51% 112M 1s 2020-04-28T12:46:40.086 INFO:teuthology.orchestra.run.smithi092.stderr: 47700K .......... .......... .......... .......... .......... 51% 79.5M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 47750K .......... .......... .......... .......... .......... 51% 96.7M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 47800K .......... .......... .......... .......... .......... 51% 69.3M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 47850K .......... .......... .......... .......... .......... 51% 117M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 47900K .......... .......... .......... .......... .......... 51% 113M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 47950K .......... .......... .......... .......... .......... 51% 84.5M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 48000K .......... .......... .......... .......... .......... 51% 88.0M 1s 2020-04-28T12:46:40.087 INFO:teuthology.orchestra.run.smithi092.stderr: 48050K .......... .......... .......... .......... .......... 51% 98.5M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48100K .......... .......... .......... .......... .......... 51% 106M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48150K .......... .......... .......... .......... .......... 51% 107M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48200K .......... .......... .......... .......... .......... 51% 118M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48250K .......... .......... .......... .......... .......... 51% 113M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48300K .......... .......... .......... .......... .......... 52% 117M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48350K .......... .......... .......... .......... .......... 52% 89.3M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48400K .......... .......... .......... .......... .......... 52% 118M 1s 2020-04-28T12:46:40.088 INFO:teuthology.orchestra.run.smithi092.stderr: 48450K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48500K .......... .......... .......... .......... .......... 52% 92.1M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48550K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48600K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48650K .......... .......... .......... .......... .......... 52% 83.2M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48700K .......... .......... .......... .......... .......... 52% 66.6M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48750K .......... .......... .......... .......... .......... 52% 55.8M 0s 2020-04-28T12:46:40.089 INFO:teuthology.orchestra.run.smithi092.stderr: 48800K .......... .......... .......... .......... .......... 52% 66.8M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 48850K .......... .......... .......... .......... .......... 52% 113M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 48900K .......... .......... .......... .......... .......... 52% 117M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 48950K .......... .......... .......... .......... .......... 52% 75.6M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 49000K .......... .......... .......... .......... .......... 52% 57.4M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 49050K .......... .......... .......... .......... .......... 52% 69.5M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 49100K .......... .......... .......... .......... .......... 52% 119M 0s 2020-04-28T12:46:40.090 INFO:teuthology.orchestra.run.smithi092.stderr: 49150K .......... .......... .......... .......... .......... 52% 60.5M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49200K .......... .......... .......... .......... .......... 53% 98.2M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49250K .......... .......... .......... .......... .......... 53% 118M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49300K .......... .......... .......... .......... .......... 53% 78.2M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49350K .......... .......... .......... .......... .......... 53% 96.0M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49400K .......... .......... .......... .......... .......... 53% 66.9M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49450K .......... .......... .......... .......... .......... 53% 118M 0s 2020-04-28T12:46:40.091 INFO:teuthology.orchestra.run.smithi092.stderr: 49500K .......... .......... .......... .......... .......... 53% 79.6M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49550K .......... .......... .......... .......... .......... 53% 90.3M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49600K .......... .......... .......... .......... .......... 53% 116M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49650K .......... .......... .......... .......... .......... 53% 71.8M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49700K .......... .......... .......... .......... .......... 53% 66.2M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49750K .......... .......... .......... .......... .......... 53% 79.5M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49800K .......... .......... .......... .......... .......... 53% 111M 0s 2020-04-28T12:46:40.092 INFO:teuthology.orchestra.run.smithi092.stderr: 49850K .......... .......... .......... .......... .......... 53% 118M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 49900K .......... .......... .......... .......... .......... 53% 104M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 49950K .......... .......... .......... .......... .......... 53% 85.4M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50000K .......... .......... .......... .......... .......... 53% 81.5M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50050K .......... .......... .......... .......... .......... 53% 111M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50100K .......... .......... .......... .......... .......... 53% 112M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50150K .......... .......... .......... .......... .......... 54% 120M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50200K .......... .......... .......... .......... .......... 54% 118M 0s 2020-04-28T12:46:40.093 INFO:teuthology.orchestra.run.smithi092.stderr: 50250K .......... .......... .......... .......... .......... 54% 114M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50300K .......... .......... .......... .......... .......... 54% 101M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50350K .......... .......... .......... .......... .......... 54% 98.3M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50400K .......... .......... .......... .......... .......... 54% 113M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50450K .......... .......... .......... .......... .......... 54% 94.5M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50500K .......... .......... .......... .......... .......... 54% 92.1M 0s 2020-04-28T12:46:40.094 INFO:teuthology.orchestra.run.smithi092.stderr: 50550K .......... .......... .......... .......... .......... 54% 109M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50600K .......... .......... .......... .......... .......... 54% 115M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50650K .......... .......... .......... .......... .......... 54% 121M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50700K .......... .......... .......... .......... .......... 54% 107M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50750K .......... .......... .......... .......... .......... 54% 80.7M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50800K .......... .......... .......... .......... .......... 54% 118M 0s 2020-04-28T12:46:40.095 INFO:teuthology.orchestra.run.smithi092.stderr: 50850K .......... .......... .......... .......... .......... 54% 114M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 50900K .......... .......... .......... .......... .......... 54% 122M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 50950K .......... .......... .......... .......... .......... 54% 103M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 51000K .......... .......... .......... .......... .......... 54% 126M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 51050K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 51100K .......... .......... .......... .......... .......... 55% 95.0M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 51150K .......... .......... .......... .......... .......... 55% 96.8M 0s 2020-04-28T12:46:40.096 INFO:teuthology.orchestra.run.smithi092.stderr: 51200K .......... .......... .......... .......... .......... 55% 118M 0s 2020-04-28T12:46:40.097 INFO:teuthology.orchestra.run.smithi092.stderr: 51250K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:46:40.097 INFO:teuthology.orchestra.run.smithi092.stderr: 51300K .......... .......... .......... .......... .......... 55% 118M 0s 2020-04-28T12:46:40.097 INFO:teuthology.orchestra.run.smithi092.stderr: 51350K .......... .......... .......... .......... .......... 55% 111M 0s 2020-04-28T12:46:40.097 INFO:teuthology.orchestra.run.smithi092.stderr: 51400K .......... .......... .......... .......... .......... 55% 113M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51450K .......... .......... .......... .......... .......... 55% 117M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51500K .......... .......... .......... .......... .......... 55% 115M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51550K .......... .......... .......... .......... .......... 55% 91.5M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51600K .......... .......... .......... .......... .......... 55% 118M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51650K .......... .......... .......... .......... .......... 55% 113M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51700K .......... .......... .......... .......... .......... 55% 101M 0s 2020-04-28T12:46:40.098 INFO:teuthology.orchestra.run.smithi092.stderr: 51750K .......... .......... .......... .......... .......... 55% 86.8M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 51800K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 51850K .......... .......... .......... .......... .......... 55% 78.3M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 51900K .......... .......... .......... .......... .......... 55% 105M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 51950K .......... .......... .......... .......... .......... 55% 91.6M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 52000K .......... .......... .......... .......... .......... 56% 113M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 52050K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:46:40.099 INFO:teuthology.orchestra.run.smithi092.stderr: 52100K .......... .......... .......... .......... .......... 56% 116M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52150K .......... .......... .......... .......... .......... 56% 107M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52200K .......... .......... .......... .......... .......... 56% 120M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52250K .......... .......... .......... .......... .......... 56% 120M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52300K .......... .......... .......... .......... .......... 56% 119M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52350K .......... .......... .......... .......... .......... 56% 87.3M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52400K .......... .......... .......... .......... .......... 56% 99.6M 0s 2020-04-28T12:46:40.100 INFO:teuthology.orchestra.run.smithi092.stderr: 52450K .......... .......... .......... .......... .......... 56% 74.0M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52500K .......... .......... .......... .......... .......... 56% 118M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52550K .......... .......... .......... .......... .......... 56% 121M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52600K .......... .......... .......... .......... .......... 56% 121M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52650K .......... .......... .......... .......... .......... 56% 112M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52700K .......... .......... .......... .......... .......... 56% 93.6M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52750K .......... .......... .......... .......... .......... 56% 83.3M 0s 2020-04-28T12:46:40.101 INFO:teuthology.orchestra.run.smithi092.stderr: 52800K .......... .......... .......... .......... .......... 56% 119M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 52850K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 52900K .......... .......... .......... .......... .......... 56% 107M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 52950K .......... .......... .......... .......... .......... 57% 122M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 53000K .......... .......... .......... .......... .......... 57% 121M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 53050K .......... .......... .......... .......... .......... 57% 113M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 53100K .......... .......... .......... .......... .......... 57% 109M 0s 2020-04-28T12:46:40.102 INFO:teuthology.orchestra.run.smithi092.stderr: 53150K .......... .......... .......... .......... .......... 57% 92.3M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53200K .......... .......... .......... .......... .......... 57% 100M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53250K .......... .......... .......... .......... .......... 57% 62.8M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53300K .......... .......... .......... .......... .......... 57% 121M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53350K .......... .......... .......... .......... .......... 57% 110M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53400K .......... .......... .......... .......... .......... 57% 60.6M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53450K .......... .......... .......... .......... .......... 57% 80.6M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53500K .......... .......... .......... .......... .......... 57% 114M 0s 2020-04-28T12:46:40.103 INFO:teuthology.orchestra.run.smithi092.stderr: 53550K .......... .......... .......... .......... .......... 57% 74.2M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53600K .......... .......... .......... .......... .......... 57% 97.2M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53650K .......... .......... .......... .......... .......... 57% 85.4M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53700K .......... .......... .......... .......... .......... 57% 73.6M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53750K .......... .......... .......... .......... .......... 57% 109M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53800K .......... .......... .......... .......... .......... 57% 87.4M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53850K .......... .......... .......... .......... .......... 58% 93.7M 0s 2020-04-28T12:46:40.104 INFO:teuthology.orchestra.run.smithi092.stderr: 53900K .......... .......... .......... .......... .......... 58% 69.4M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 53950K .......... .......... .......... .......... .......... 58% 85.9M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54000K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54050K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54100K .......... .......... .......... .......... .......... 58% 95.7M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54150K .......... .......... .......... .......... .......... 58% 73.1M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54200K .......... .......... .......... .......... .......... 58% 63.1M 0s 2020-04-28T12:46:40.105 INFO:teuthology.orchestra.run.smithi092.stderr: 54250K .......... .......... .......... .......... .......... 58% 120M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54300K .......... .......... .......... .......... .......... 58% 90.9M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54350K .......... .......... .......... .......... .......... 58% 96.2M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54400K .......... .......... .......... .......... .......... 58% 89.4M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54450K .......... .......... .......... .......... .......... 58% 114M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54500K .......... .......... .......... .......... .......... 58% 118M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54550K .......... .......... .......... .......... .......... 58% 73.2M 0s 2020-04-28T12:46:40.106 INFO:teuthology.orchestra.run.smithi092.stderr: 54600K .......... .......... .......... .......... .......... 58% 96.0M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54650K .......... .......... .......... .......... .......... 58% 67.5M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54700K .......... .......... .......... .......... .......... 58% 114M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54750K .......... .......... .......... .......... .......... 58% 68.3M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54800K .......... .......... .......... .......... .......... 59% 109M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54850K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54900K .......... .......... .......... .......... .......... 59% 112M 0s 2020-04-28T12:46:40.107 INFO:teuthology.orchestra.run.smithi092.stderr: 54950K .......... .......... .......... .......... .......... 59% 116M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55000K .......... .......... .......... .......... .......... 59% 110M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55050K .......... .......... .......... .......... .......... 59% 123M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55100K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55150K .......... .......... .......... .......... .......... 59% 91.8M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55200K .......... .......... .......... .......... .......... 59% 108M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55250K .......... .......... .......... .......... .......... 59% 125M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55300K .......... .......... .......... .......... .......... 59% 107M 0s 2020-04-28T12:46:40.108 INFO:teuthology.orchestra.run.smithi092.stderr: 55350K .......... .......... .......... .......... .......... 59% 117M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55400K .......... .......... .......... .......... .......... 59% 113M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55450K .......... .......... .......... .......... .......... 59% 119M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55500K .......... .......... .......... .......... .......... 59% 113M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55550K .......... .......... .......... .......... .......... 59% 90.0M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55600K .......... .......... .......... .......... .......... 59% 121M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55650K .......... .......... .......... .......... .......... 59% 114M 0s 2020-04-28T12:46:40.109 INFO:teuthology.orchestra.run.smithi092.stderr: 55700K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 55750K .......... .......... .......... .......... .......... 60% 110M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 55800K .......... .......... .......... .......... .......... 60% 124M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 55850K .......... .......... .......... .......... .......... 60% 105M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 55900K .......... .......... .......... .......... .......... 60% 128M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 55950K .......... .......... .......... .......... .......... 60% 91.5M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 56000K .......... .......... .......... .......... .......... 60% 115M 0s 2020-04-28T12:46:40.110 INFO:teuthology.orchestra.run.smithi092.stderr: 56050K .......... .......... .......... .......... .......... 60% 111M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56100K .......... .......... .......... .......... .......... 60% 117M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56150K .......... .......... .......... .......... .......... 60% 111M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56200K .......... .......... .......... .......... .......... 60% 116M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56250K .......... .......... .......... .......... .......... 60% 123M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56300K .......... .......... .......... .......... .......... 60% 115M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56350K .......... .......... .......... .......... .......... 60% 88.2M 0s 2020-04-28T12:46:40.111 INFO:teuthology.orchestra.run.smithi092.stderr: 56400K .......... .......... .......... .......... .......... 60% 115M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56450K .......... .......... .......... .......... .......... 60% 91.3M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56500K .......... .......... .......... .......... .......... 60% 106M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56550K .......... .......... .......... .......... .......... 60% 180M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56600K .......... .......... .......... .......... .......... 60% 99.9M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56650K .......... .......... .......... .......... .......... 61% 83.1M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56700K .......... .......... .......... .......... .......... 61% 111M 0s 2020-04-28T12:46:40.112 INFO:teuthology.orchestra.run.smithi092.stderr: 56750K .......... .......... .......... .......... .......... 61% 87.8M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 56800K .......... .......... .......... .......... .......... 61% 110M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 56850K .......... .......... .......... .......... .......... 61% 114M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 56900K .......... .......... .......... .......... .......... 61% 110M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 56950K .......... .......... .......... .......... .......... 61% 115M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 57000K .......... .......... .......... .......... .......... 61% 117M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 57050K .......... .......... .......... .......... .......... 61% 77.8M 0s 2020-04-28T12:46:40.113 INFO:teuthology.orchestra.run.smithi092.stderr: 57100K .......... .......... .......... .......... .......... 61% 125M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57150K .......... .......... .......... .......... .......... 61% 87.6M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57200K .......... .......... .......... .......... .......... 61% 120M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57250K .......... .......... .......... .......... .......... 61% 113M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57300K .......... .......... .......... .......... .......... 61% 108M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57350K .......... .......... .......... .......... .......... 61% 111M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57400K .......... .......... .......... .......... .......... 61% 115M 0s 2020-04-28T12:46:40.114 INFO:teuthology.orchestra.run.smithi092.stderr: 57450K .......... .......... .......... .......... .......... 61% 93.8M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57500K .......... .......... .......... .......... .......... 61% 152M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57550K .......... .......... .......... .......... .......... 62% 87.7M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57600K .......... .......... .......... .......... .......... 62% 85.2M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57650K .......... .......... .......... .......... .......... 62% 99.9M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57700K .......... .......... .......... .......... .......... 62% 115M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57750K .......... .......... .......... .......... .......... 62% 107M 0s 2020-04-28T12:46:40.115 INFO:teuthology.orchestra.run.smithi092.stderr: 57800K .......... .......... .......... .......... .......... 62% 67.1M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 57850K .......... .......... .......... .......... .......... 62% 126M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 57900K .......... .......... .......... .......... .......... 62% 120M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 57950K .......... .......... .......... .......... .......... 62% 28.8M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 58000K .......... .......... .......... .......... .......... 62% 219M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 58050K .......... .......... .......... .......... .......... 62% 87.5M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 58100K .......... .......... .......... .......... .......... 62% 79.5M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 58150K .......... .......... .......... .......... .......... 62% 109M 0s 2020-04-28T12:46:40.116 INFO:teuthology.orchestra.run.smithi092.stderr: 58200K .......... .......... .......... .......... .......... 62% 79.4M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58250K .......... .......... .......... .......... .......... 62% 83.0M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58300K .......... .......... .......... .......... .......... 62% 86.5M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58350K .......... .......... .......... .......... .......... 62% 59.8M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58400K .......... .......... .......... .......... .......... 62% 78.0M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58450K .......... .......... .......... .......... .......... 62% 109M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58500K .......... .......... .......... .......... .......... 63% 102M 0s 2020-04-28T12:46:40.117 INFO:teuthology.orchestra.run.smithi092.stderr: 58550K .......... .......... .......... .......... .......... 63% 67.8M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58600K .......... .......... .......... .......... .......... 63% 113M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58650K .......... .......... .......... .......... .......... 63% 129M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58700K .......... .......... .......... .......... .......... 63% 117M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58750K .......... .......... .......... .......... .......... 63% 76.1M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58800K .......... .......... .......... .......... .......... 63% 71.3M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58850K .......... .......... .......... .......... .......... 63% 63.2M 0s 2020-04-28T12:46:40.118 INFO:teuthology.orchestra.run.smithi092.stderr: 58900K .......... .......... .......... .......... .......... 63% 119M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 58950K .......... .......... .......... .......... .......... 63% 99.3M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59000K .......... .......... .......... .......... .......... 63% 93.1M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59050K .......... .......... .......... .......... .......... 63% 78.4M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59100K .......... .......... .......... .......... .......... 63% 78.7M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59150K .......... .......... .......... .......... .......... 63% 72.3M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59200K .......... .......... .......... .......... .......... 63% 106M 0s 2020-04-28T12:46:40.119 INFO:teuthology.orchestra.run.smithi092.stderr: 59250K .......... .......... .......... .......... .......... 63% 67.3M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59300K .......... .......... .......... .......... .......... 63% 82.3M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59350K .......... .......... .......... .......... .......... 63% 108M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59400K .......... .......... .......... .......... .......... 63% 117M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59450K .......... .......... .......... .......... .......... 64% 116M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59500K .......... .......... .......... .......... .......... 64% 111M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59550K .......... .......... .......... .......... .......... 64% 88.1M 0s 2020-04-28T12:46:40.120 INFO:teuthology.orchestra.run.smithi092.stderr: 59600K .......... .......... .......... .......... .......... 64% 116M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59650K .......... .......... .......... .......... .......... 64% 120M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59700K .......... .......... .......... .......... .......... 64% 89.1M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59750K .......... .......... .......... .......... .......... 64% 80.8M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59800K .......... .......... .......... .......... .......... 64% 120M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59850K .......... .......... .......... .......... .......... 64% 127M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59900K .......... .......... .......... .......... .......... 64% 98.6M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 59950K .......... .......... .......... .......... .......... 64% 89.2M 0s 2020-04-28T12:46:40.121 INFO:teuthology.orchestra.run.smithi092.stderr: 60000K .......... .......... .......... .......... .......... 64% 115M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60050K .......... .......... .......... .......... .......... 64% 103M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60100K .......... .......... .......... .......... .......... 64% 105M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60150K .......... .......... .......... .......... .......... 64% 114M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60200K .......... .......... .......... .......... .......... 64% 105M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60250K .......... .......... .......... .......... .......... 64% 108M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60300K .......... .......... .......... .......... .......... 64% 119M 0s 2020-04-28T12:46:40.122 INFO:teuthology.orchestra.run.smithi092.stderr: 60350K .......... .......... .......... .......... .......... 65% 85.0M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60400K .......... .......... .......... .......... .......... 65% 127M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60450K .......... .......... .......... .......... .......... 65% 111M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60500K .......... .......... .......... .......... .......... 65% 118M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60550K .......... .......... .......... .......... .......... 65% 104M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60600K .......... .......... .......... .......... .......... 65% 124M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60650K .......... .......... .......... .......... .......... 65% 110M 0s 2020-04-28T12:46:40.123 INFO:teuthology.orchestra.run.smithi092.stderr: 60700K .......... .......... .......... .......... .......... 65% 119M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 60750K .......... .......... .......... .......... .......... 65% 85.5M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 60800K .......... .......... .......... .......... .......... 65% 122M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 60850K .......... .......... .......... .......... .......... 65% 98.3M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 60900K .......... .......... .......... .......... .......... 65% 97.8M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 60950K .......... .......... .......... .......... .......... 65% 135M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 61000K .......... .......... .......... .......... .......... 65% 139M 0s 2020-04-28T12:46:40.124 INFO:teuthology.orchestra.run.smithi092.stderr: 61050K .......... .......... .......... .......... .......... 65% 102M 0s 2020-04-28T12:46:40.125 INFO:teuthology.orchestra.run.smithi092.stderr: 61100K .......... .......... .......... .......... .......... 65% 130M 0s 2020-04-28T12:46:40.125 INFO:teuthology.orchestra.run.smithi092.stderr: 61150K .......... .......... .......... .......... .......... 65% 90.5M 0s 2020-04-28T12:46:40.125 INFO:teuthology.orchestra.run.smithi092.stderr: 61200K .......... .......... .......... .......... .......... 65% 117M 0s 2020-04-28T12:46:40.125 INFO:teuthology.orchestra.run.smithi092.stderr: 61250K .......... .......... .......... .......... .......... 65% 114M 0s 2020-04-28T12:46:40.125 INFO:teuthology.orchestra.run.smithi092.stderr: 61300K .......... .......... .......... .......... .......... 66% 118M 0s 2020-04-28T12:46:40.126 INFO:teuthology.orchestra.run.smithi092.stderr: 61350K .......... .......... .......... .......... .......... 66% 84.8M 0s 2020-04-28T12:46:40.126 INFO:teuthology.orchestra.run.smithi092.stderr: 61400K .......... .......... .......... .......... .......... 66% 130M 0s 2020-04-28T12:46:40.126 INFO:teuthology.orchestra.run.smithi092.stderr: 61450K .......... .......... .......... .......... .......... 66% 106M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61500K .......... .......... .......... .......... .......... 66% 103M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61550K .......... .......... .......... .......... .......... 66% 76.6M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61600K .......... .......... .......... .......... .......... 66% 136M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61650K .......... .......... .......... .......... .......... 66% 132M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61700K .......... .......... .......... .......... .......... 66% 71.8M 0s 2020-04-28T12:46:40.127 INFO:teuthology.orchestra.run.smithi092.stderr: 61750K .......... .......... .......... .......... .......... 66% 144M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 61800K .......... .......... .......... .......... .......... 66% 87.2M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 61850K .......... .......... .......... .......... .......... 66% 152M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 61900K .......... .......... .......... .......... .......... 66% 136M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 61950K .......... .......... .......... .......... .......... 66% 92.0M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 62000K .......... .......... .......... .......... .......... 66% 104M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 62050K .......... .......... .......... .......... .......... 66% 93.0M 0s 2020-04-28T12:46:40.128 INFO:teuthology.orchestra.run.smithi092.stderr: 62100K .......... .......... .......... .......... .......... 66% 124M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62150K .......... .......... .......... .......... .......... 66% 89.3M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62200K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62250K .......... .......... .......... .......... .......... 67% 100M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62300K .......... .......... .......... .......... .......... 67% 78.0M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62350K .......... .......... .......... .......... .......... 67% 128M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62400K .......... .......... .......... .......... .......... 67% 141M 0s 2020-04-28T12:46:40.129 INFO:teuthology.orchestra.run.smithi092.stderr: 62450K .......... .......... .......... .......... .......... 67% 67.9M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62500K .......... .......... .......... .......... .......... 67% 87.9M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62550K .......... .......... .......... .......... .......... 67% 104M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62600K .......... .......... .......... .......... .......... 67% 78.0M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62650K .......... .......... .......... .......... .......... 67% 206M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62700K .......... .......... .......... .......... .......... 67% 54.1M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62750K .......... .......... .......... .......... .......... 67% 70.7M 0s 2020-04-28T12:46:40.130 INFO:teuthology.orchestra.run.smithi092.stderr: 62800K .......... .......... .......... .......... .......... 67% 78.9M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 62850K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 62900K .......... .......... .......... .......... .......... 67% 112M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 62950K .......... .......... .......... .......... .......... 67% 86.4M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 63000K .......... .......... .......... .......... .......... 67% 74.6M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 63050K .......... .......... .......... .......... .......... 67% 128M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 63100K .......... .......... .......... .......... .......... 67% 82.8M 0s 2020-04-28T12:46:40.131 INFO:teuthology.orchestra.run.smithi092.stderr: 63150K .......... .......... .......... .......... .......... 68% 64.6M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63200K .......... .......... .......... .......... .......... 68% 116M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63250K .......... .......... .......... .......... .......... 68% 95.2M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63300K .......... .......... .......... .......... .......... 68% 68.8M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63350K .......... .......... .......... .......... .......... 68% 122M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63400K .......... .......... .......... .......... .......... 68% 120M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63450K .......... .......... .......... .......... .......... 68% 90.0M 0s 2020-04-28T12:46:40.132 INFO:teuthology.orchestra.run.smithi092.stderr: 63500K .......... .......... .......... .......... .......... 68% 102M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63550K .......... .......... .......... .......... .......... 68% 53.7M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63600K .......... .......... .......... .......... .......... 68% 141M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63650K .......... .......... .......... .......... .......... 68% 82.8M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63700K .......... .......... .......... .......... .......... 68% 60.8M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63750K .......... .......... .......... .......... .......... 68% 113M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63800K .......... .......... .......... .......... .......... 68% 114M 0s 2020-04-28T12:46:40.133 INFO:teuthology.orchestra.run.smithi092.stderr: 63850K .......... .......... .......... .......... .......... 68% 97.4M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 63900K .......... .......... .......... .......... .......... 68% 118M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 63950K .......... .......... .......... .......... .......... 68% 76.8M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 64000K .......... .......... .......... .......... .......... 68% 80.9M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 64050K .......... .......... .......... .......... .......... 68% 121M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 64100K .......... .......... .......... .......... .......... 69% 79.4M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 64150K .......... .......... .......... .......... .......... 69% 106M 0s 2020-04-28T12:46:40.134 INFO:teuthology.orchestra.run.smithi092.stderr: 64200K .......... .......... .......... .......... .......... 69% 64.3M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64250K .......... .......... .......... .......... .......... 69% 79.8M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64300K .......... .......... .......... .......... .......... 69% 120M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64350K .......... .......... .......... .......... .......... 69% 83.6M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64400K .......... .......... .......... .......... .......... 69% 79.4M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64450K .......... .......... .......... .......... .......... 69% 97.6M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64500K .......... .......... .......... .......... .......... 69% 113M 0s 2020-04-28T12:46:40.135 INFO:teuthology.orchestra.run.smithi092.stderr: 64550K .......... .......... .......... .......... .......... 69% 111M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64600K .......... .......... .......... .......... .......... 69% 96.9M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64650K .......... .......... .......... .......... .......... 69% 111M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64700K .......... .......... .......... .......... .......... 69% 124M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64750K .......... .......... .......... .......... .......... 69% 86.8M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64800K .......... .......... .......... .......... .......... 69% 124M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64850K .......... .......... .......... .......... .......... 69% 117M 0s 2020-04-28T12:46:40.136 INFO:teuthology.orchestra.run.smithi092.stderr: 64900K .......... .......... .......... .......... .......... 69% 112M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 64950K .......... .......... .......... .......... .......... 69% 113M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65000K .......... .......... .......... .......... .......... 70% 108M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65050K .......... .......... .......... .......... .......... 70% 126M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65100K .......... .......... .......... .......... .......... 70% 113M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65150K .......... .......... .......... .......... .......... 70% 84.0M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65200K .......... .......... .......... .......... .......... 70% 126M 0s 2020-04-28T12:46:40.137 INFO:teuthology.orchestra.run.smithi092.stderr: 65250K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65300K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65350K .......... .......... .......... .......... .......... 70% 110M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65400K .......... .......... .......... .......... .......... 70% 116M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65450K .......... .......... .......... .......... .......... 70% 113M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65500K .......... .......... .......... .......... .......... 70% 118M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65550K .......... .......... .......... .......... .......... 70% 67.4M 0s 2020-04-28T12:46:40.138 INFO:teuthology.orchestra.run.smithi092.stderr: 65600K .......... .......... .......... .......... .......... 70% 159M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65650K .......... .......... .......... .......... .......... 70% 139M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65700K .......... .......... .......... .......... .......... 70% 95.0M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65750K .......... .......... .......... .......... .......... 70% 107M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65800K .......... .......... .......... .......... .......... 70% 106M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65850K .......... .......... .......... .......... .......... 70% 138M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65900K .......... .......... .......... .......... .......... 70% 98.1M 0s 2020-04-28T12:46:40.139 INFO:teuthology.orchestra.run.smithi092.stderr: 65950K .......... .......... .......... .......... .......... 71% 85.0M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66000K .......... .......... .......... .......... .......... 71% 101M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66050K .......... .......... .......... .......... .......... 71% 125M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66100K .......... .......... .......... .......... .......... 71% 100M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66150K .......... .......... .......... .......... .......... 71% 105M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66200K .......... .......... .......... .......... .......... 71% 123M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66250K .......... .......... .......... .......... .......... 71% 113M 0s 2020-04-28T12:46:40.140 INFO:teuthology.orchestra.run.smithi092.stderr: 66300K .......... .......... .......... .......... .......... 71% 115M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66350K .......... .......... .......... .......... .......... 71% 93.8M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66400K .......... .......... .......... .......... .......... 71% 111M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66450K .......... .......... .......... .......... .......... 71% 119M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66500K .......... .......... .......... .......... .......... 71% 115M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66550K .......... .......... .......... .......... .......... 71% 116M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66600K .......... .......... .......... .......... .......... 71% 101M 0s 2020-04-28T12:46:40.141 INFO:teuthology.orchestra.run.smithi092.stderr: 66650K .......... .......... .......... .......... .......... 71% 131M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66700K .......... .......... .......... .......... .......... 71% 118M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66750K .......... .......... .......... .......... .......... 71% 70.5M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66800K .......... .......... .......... .......... .......... 71% 128M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66850K .......... .......... .......... .......... .......... 72% 121M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66900K .......... .......... .......... .......... .......... 72% 114M 0s 2020-04-28T12:46:40.142 INFO:teuthology.orchestra.run.smithi092.stderr: 66950K .......... .......... .......... .......... .......... 72% 114M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67000K .......... .......... .......... .......... .......... 72% 113M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67050K .......... .......... .......... .......... .......... 72% 117M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67100K .......... .......... .......... .......... .......... 72% 71.6M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67150K .......... .......... .......... .......... .......... 72% 76.1M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67200K .......... .......... .......... .......... .......... 72% 113M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67250K .......... .......... .......... .......... .......... 72% 119M 0s 2020-04-28T12:46:40.143 INFO:teuthology.orchestra.run.smithi092.stderr: 67300K .......... .......... .......... .......... .......... 72% 66.0M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67350K .......... .......... .......... .......... .......... 72% 85.9M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67400K .......... .......... .......... .......... .......... 72% 93.8M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67450K .......... .......... .......... .......... .......... 72% 118M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67500K .......... .......... .......... .......... .......... 72% 69.4M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67550K .......... .......... .......... .......... .......... 72% 79.4M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67600K .......... .......... .......... .......... .......... 72% 112M 0s 2020-04-28T12:46:40.144 INFO:teuthology.orchestra.run.smithi092.stderr: 67650K .......... .......... .......... .......... .......... 72% 103M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67700K .......... .......... .......... .......... .......... 72% 84.4M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67750K .......... .......... .......... .......... .......... 72% 120M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67800K .......... .......... .......... .......... .......... 73% 77.4M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67850K .......... .......... .......... .......... .......... 73% 76.1M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67900K .......... .......... .......... .......... .......... 73% 81.5M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 67950K .......... .......... .......... .......... .......... 73% 71.6M 0s 2020-04-28T12:46:40.145 INFO:teuthology.orchestra.run.smithi092.stderr: 68000K .......... .......... .......... .......... .......... 73% 119M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68050K .......... .......... .......... .......... .......... 73% 87.3M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68100K .......... .......... .......... .......... .......... 73% 80.9M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68150K .......... .......... .......... .......... .......... 73% 98.1M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68200K .......... .......... .......... .......... .......... 73% 135M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68250K .......... .......... .......... .......... .......... 73% 72.8M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68300K .......... .......... .......... .......... .......... 73% 90.7M 0s 2020-04-28T12:46:40.146 INFO:teuthology.orchestra.run.smithi092.stderr: 68350K .......... .......... .......... .......... .......... 73% 81.6M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68400K .......... .......... .......... .......... .......... 73% 84.1M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68450K .......... .......... .......... .......... .......... 73% 118M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68500K .......... .......... .......... .......... .......... 73% 117M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68550K .......... .......... .......... .......... .......... 73% 53.6M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68600K .......... .......... .......... .......... .......... 73% 124M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68650K .......... .......... .......... .......... .......... 73% 89.5M 0s 2020-04-28T12:46:40.147 INFO:teuthology.orchestra.run.smithi092.stderr: 68700K .......... .......... .......... .......... .......... 74% 104M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 68750K .......... .......... .......... .......... .......... 74% 78.7M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 68800K .......... .......... .......... .......... .......... 74% 132M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 68850K .......... .......... .......... .......... .......... 74% 97.7M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 68900K .......... .......... .......... .......... .......... 74% 89.1M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 68950K .......... .......... .......... .......... .......... 74% 91.1M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 69000K .......... .......... .......... .......... .......... 74% 97.1M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 69050K .......... .......... .......... .......... .......... 74% 119M 0s 2020-04-28T12:46:40.148 INFO:teuthology.orchestra.run.smithi092.stderr: 69100K .......... .......... .......... .......... .......... 74% 70.3M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69150K .......... .......... .......... .......... .......... 74% 78.6M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69200K .......... .......... .......... .......... .......... 74% 71.9M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69250K .......... .......... .......... .......... .......... 74% 116M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69300K .......... .......... .......... .......... .......... 74% 114M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69350K .......... .......... .......... .......... .......... 74% 113M 0s 2020-04-28T12:46:40.149 INFO:teuthology.orchestra.run.smithi092.stderr: 69400K .......... .......... .......... .......... .......... 74% 118M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69450K .......... .......... .......... .......... .......... 74% 114M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69500K .......... .......... .......... .......... .......... 74% 110M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69550K .......... .......... .......... .......... .......... 74% 93.2M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69600K .......... .......... .......... .......... .......... 74% 111M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69650K .......... .......... .......... .......... .......... 75% 112M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69700K .......... .......... .......... .......... .......... 75% 115M 0s 2020-04-28T12:46:40.150 INFO:teuthology.orchestra.run.smithi092.stderr: 69750K .......... .......... .......... .......... .......... 75% 90.0M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 69800K .......... .......... .......... .......... .......... 75% 129M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 69850K .......... .......... .......... .......... .......... 75% 91.1M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 69900K .......... .......... .......... .......... .......... 75% 107M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 69950K .......... .......... .......... .......... .......... 75% 91.6M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 70000K .......... .......... .......... .......... .......... 75% 78.8M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 70050K .......... .......... .......... .......... .......... 75% 97.8M 0s 2020-04-28T12:46:40.151 INFO:teuthology.orchestra.run.smithi092.stderr: 70100K .......... .......... .......... .......... .......... 75% 92.5M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70150K .......... .......... .......... .......... .......... 75% 115M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70200K .......... .......... .......... .......... .......... 75% 113M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70250K .......... .......... .......... .......... .......... 75% 114M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70300K .......... .......... .......... .......... .......... 75% 122M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70350K .......... .......... .......... .......... .......... 75% 84.5M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70400K .......... .......... .......... .......... .......... 75% 76.3M 0s 2020-04-28T12:46:40.152 INFO:teuthology.orchestra.run.smithi092.stderr: 70450K .......... .......... .......... .......... .......... 75% 99.8M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70500K .......... .......... .......... .......... .......... 75% 93.5M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70550K .......... .......... .......... .......... .......... 75% 96.8M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70600K .......... .......... .......... .......... .......... 76% 117M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70650K .......... .......... .......... .......... .......... 76% 117M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70700K .......... .......... .......... .......... .......... 76% 87.7M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70750K .......... .......... .......... .......... .......... 76% 102M 0s 2020-04-28T12:46:40.153 INFO:teuthology.orchestra.run.smithi092.stderr: 70800K .......... .......... .......... .......... .......... 76% 104M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 70850K .......... .......... .......... .......... .......... 76% 109M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 70900K .......... .......... .......... .......... .......... 76% 117M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 70950K .......... .......... .......... .......... .......... 76% 110M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 71000K .......... .......... .......... .......... .......... 76% 100M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 71050K .......... .......... .......... .......... .......... 76% 107M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 71100K .......... .......... .......... .......... .......... 76% 123M 0s 2020-04-28T12:46:40.154 INFO:teuthology.orchestra.run.smithi092.stderr: 71150K .......... .......... .......... .......... .......... 76% 83.4M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71200K .......... .......... .......... .......... .......... 76% 117M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71250K .......... .......... .......... .......... .......... 76% 106M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71300K .......... .......... .......... .......... .......... 76% 120M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71350K .......... .......... .......... .......... .......... 76% 105M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71400K .......... .......... .......... .......... .......... 76% 118M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71450K .......... .......... .......... .......... .......... 76% 114M 0s 2020-04-28T12:46:40.155 INFO:teuthology.orchestra.run.smithi092.stderr: 71500K .......... .......... .......... .......... .......... 77% 86.2M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71550K .......... .......... .......... .......... .......... 77% 95.0M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71600K .......... .......... .......... .......... .......... 77% 102M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71650K .......... .......... .......... .......... .......... 77% 121M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71700K .......... .......... .......... .......... .......... 77% 106M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71750K .......... .......... .......... .......... .......... 77% 75.7M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71800K .......... .......... .......... .......... .......... 77% 96.1M 0s 2020-04-28T12:46:40.156 INFO:teuthology.orchestra.run.smithi092.stderr: 71850K .......... .......... .......... .......... .......... 77% 114M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 71900K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 71950K .......... .......... .......... .......... .......... 77% 49.1M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 72000K .......... .......... .......... .......... .......... 77% 93.7M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 72050K .......... .......... .......... .......... .......... 77% 115M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 72100K .......... .......... .......... .......... .......... 77% 61.9M 0s 2020-04-28T12:46:40.157 INFO:teuthology.orchestra.run.smithi092.stderr: 72150K .......... .......... .......... .......... .......... 77% 95.6M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72200K .......... .......... .......... .......... .......... 77% 104M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72250K .......... .......... .......... .......... .......... 77% 98.5M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72300K .......... .......... .......... .......... .......... 77% 111M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72350K .......... .......... .......... .......... .......... 77% 71.3M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72400K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72450K .......... .......... .......... .......... .......... 78% 76.7M 0s 2020-04-28T12:46:40.158 INFO:teuthology.orchestra.run.smithi092.stderr: 72500K .......... .......... .......... .......... .......... 78% 76.4M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72550K .......... .......... .......... .......... .......... 78% 106M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72600K .......... .......... .......... .......... .......... 78% 93.5M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72650K .......... .......... .......... .......... .......... 78% 122M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72700K .......... .......... .......... .......... .......... 78% 106M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72750K .......... .......... .......... .......... .......... 78% 65.1M 0s 2020-04-28T12:46:40.159 INFO:teuthology.orchestra.run.smithi092.stderr: 72800K .......... .......... .......... .......... .......... 78% 111M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 72850K .......... .......... .......... .......... .......... 78% 102M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 72900K .......... .......... .......... .......... .......... 78% 129M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 72950K .......... .......... .......... .......... .......... 78% 71.7M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 73000K .......... .......... .......... .......... .......... 78% 65.5M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 73050K .......... .......... .......... .......... .......... 78% 74.1M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 73100K .......... .......... .......... .......... .......... 78% 131M 0s 2020-04-28T12:46:40.160 INFO:teuthology.orchestra.run.smithi092.stderr: 73150K .......... .......... .......... .......... .......... 78% 40.9M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73200K .......... .......... .......... .......... .......... 78% 114M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73250K .......... .......... .......... .......... .......... 78% 100M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73300K .......... .......... .......... .......... .......... 78% 112M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73350K .......... .......... .......... .......... .......... 79% 111M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73400K .......... .......... .......... .......... .......... 79% 74.6M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73450K .......... .......... .......... .......... .......... 79% 80.6M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73500K .......... .......... .......... .......... .......... 79% 65.5M 0s 2020-04-28T12:46:40.161 INFO:teuthology.orchestra.run.smithi092.stderr: 73550K .......... .......... .......... .......... .......... 79% 107M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73600K .......... .......... .......... .......... .......... 79% 69.8M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73650K .......... .......... .......... .......... .......... 79% 117M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73700K .......... .......... .......... .......... .......... 79% 78.3M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73750K .......... .......... .......... .......... .......... 79% 81.7M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73800K .......... .......... .......... .......... .......... 79% 118M 0s 2020-04-28T12:46:40.162 INFO:teuthology.orchestra.run.smithi092.stderr: 73850K .......... .......... .......... .......... .......... 79% 107M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 73900K .......... .......... .......... .......... .......... 79% 117M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 73950K .......... .......... .......... .......... .......... 79% 84.3M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74000K .......... .......... .......... .......... .......... 79% 110M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74050K .......... .......... .......... .......... .......... 79% 102M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74100K .......... .......... .......... .......... .......... 79% 136M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74150K .......... .......... .......... .......... .......... 79% 104M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74200K .......... .......... .......... .......... .......... 79% 107M 0s 2020-04-28T12:46:40.163 INFO:teuthology.orchestra.run.smithi092.stderr: 74250K .......... .......... .......... .......... .......... 79% 113M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74300K .......... .......... .......... .......... .......... 80% 107M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74350K .......... .......... .......... .......... .......... 80% 74.8M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74400K .......... .......... .......... .......... .......... 80% 117M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74450K .......... .......... .......... .......... .......... 80% 116M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74500K .......... .......... .......... .......... .......... 80% 98.0M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74550K .......... .......... .......... .......... .......... 80% 91.1M 0s 2020-04-28T12:46:40.164 INFO:teuthology.orchestra.run.smithi092.stderr: 74600K .......... .......... .......... .......... .......... 80% 117M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74650K .......... .......... .......... .......... .......... 80% 108M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74700K .......... .......... .......... .......... .......... 80% 111M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74750K .......... .......... .......... .......... .......... 80% 81.7M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74800K .......... .......... .......... .......... .......... 80% 129M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74850K .......... .......... .......... .......... .......... 80% 121M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74900K .......... .......... .......... .......... .......... 80% 110M 0s 2020-04-28T12:46:40.165 INFO:teuthology.orchestra.run.smithi092.stderr: 74950K .......... .......... .......... .......... .......... 80% 85.6M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75000K .......... .......... .......... .......... .......... 80% 123M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75050K .......... .......... .......... .......... .......... 80% 114M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75100K .......... .......... .......... .......... .......... 80% 112M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75150K .......... .......... .......... .......... .......... 80% 88.9M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75200K .......... .......... .......... .......... .......... 81% 112M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75250K .......... .......... .......... .......... .......... 81% 113M 0s 2020-04-28T12:46:40.166 INFO:teuthology.orchestra.run.smithi092.stderr: 75300K .......... .......... .......... .......... .......... 81% 119M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75350K .......... .......... .......... .......... .......... 81% 109M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75400K .......... .......... .......... .......... .......... 81% 95.0M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75450K .......... .......... .......... .......... .......... 81% 108M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75500K .......... .......... .......... .......... .......... 81% 113M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75550K .......... .......... .......... .......... .......... 81% 87.9M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75600K .......... .......... .......... .......... .......... 81% 114M 0s 2020-04-28T12:46:40.167 INFO:teuthology.orchestra.run.smithi092.stderr: 75650K .......... .......... .......... .......... .......... 81% 107M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75700K .......... .......... .......... .......... .......... 81% 118M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75750K .......... .......... .......... .......... .......... 81% 104M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75800K .......... .......... .......... .......... .......... 81% 108M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75850K .......... .......... .......... .......... .......... 81% 121M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75900K .......... .......... .......... .......... .......... 81% 103M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 75950K .......... .......... .......... .......... .......... 81% 82.4M 0s 2020-04-28T12:46:40.168 INFO:teuthology.orchestra.run.smithi092.stderr: 76000K .......... .......... .......... .......... .......... 81% 116M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76050K .......... .......... .......... .......... .......... 81% 93.5M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76100K .......... .......... .......... .......... .......... 81% 112M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76150K .......... .......... .......... .......... .......... 82% 94.1M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76200K .......... .......... .......... .......... .......... 82% 97.7M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76250K .......... .......... .......... .......... .......... 82% 111M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76300K .......... .......... .......... .......... .......... 82% 104M 0s 2020-04-28T12:46:40.169 INFO:teuthology.orchestra.run.smithi092.stderr: 76350K .......... .......... .......... .......... .......... 82% 75.1M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76400K .......... .......... .......... .......... .......... 82% 101M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76450K .......... .......... .......... .......... .......... 82% 114M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76500K .......... .......... .......... .......... .......... 82% 49.5M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76550K .......... .......... .......... .......... .......... 82% 109M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76600K .......... .......... .......... .......... .......... 82% 82.9M 0s 2020-04-28T12:46:40.170 INFO:teuthology.orchestra.run.smithi092.stderr: 76650K .......... .......... .......... .......... .......... 82% 89.7M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76700K .......... .......... .......... .......... .......... 82% 54.3M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76750K .......... .......... .......... .......... .......... 82% 77.1M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76800K .......... .......... .......... .......... .......... 82% 102M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76850K .......... .......... .......... .......... .......... 82% 121M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76900K .......... .......... .......... .......... .......... 82% 84.1M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 76950K .......... .......... .......... .......... .......... 82% 119M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 77000K .......... .......... .......... .......... .......... 82% 88.1M 0s 2020-04-28T12:46:40.171 INFO:teuthology.orchestra.run.smithi092.stderr: 77050K .......... .......... .......... .......... .......... 82% 118M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77100K .......... .......... .......... .......... .......... 83% 72.7M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77150K .......... .......... .......... .......... .......... 83% 63.4M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77200K .......... .......... .......... .......... .......... 83% 80.7M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77250K .......... .......... .......... .......... .......... 83% 81.1M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77300K .......... .......... .......... .......... .......... 83% 104M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77350K .......... .......... .......... .......... .......... 83% 100M 0s 2020-04-28T12:46:40.172 INFO:teuthology.orchestra.run.smithi092.stderr: 77400K .......... .......... .......... .......... .......... 83% 60.3M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77450K .......... .......... .......... .......... .......... 83% 102M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77500K .......... .......... .......... .......... .......... 83% 118M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77550K .......... .......... .......... .......... .......... 83% 93.3M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77600K .......... .......... .......... .......... .......... 83% 68.6M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77650K .......... .......... .......... .......... .......... 83% 73.0M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77700K .......... .......... .......... .......... .......... 83% 70.7M 0s 2020-04-28T12:46:40.173 INFO:teuthology.orchestra.run.smithi092.stderr: 77750K .......... .......... .......... .......... .......... 83% 103M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 77800K .......... .......... .......... .......... .......... 83% 110M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 77850K .......... .......... .......... .......... .......... 83% 119M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 77900K .......... .......... .......... .......... .......... 83% 72.9M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 77950K .......... .......... .......... .......... .......... 83% 60.6M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 78000K .......... .......... .......... .......... .......... 84% 124M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 78050K .......... .......... .......... .......... .......... 84% 113M 0s 2020-04-28T12:46:40.174 INFO:teuthology.orchestra.run.smithi092.stderr: 78100K .......... .......... .......... .......... .......... 84% 90.4M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78150K .......... .......... .......... .......... .......... 84% 87.6M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78200K .......... .......... .......... .......... .......... 84% 85.1M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78250K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78300K .......... .......... .......... .......... .......... 84% 66.7M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78350K .......... .......... .......... .......... .......... 84% 64.7M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78400K .......... .......... .......... .......... .......... 84% 134M 0s 2020-04-28T12:46:40.175 INFO:teuthology.orchestra.run.smithi092.stderr: 78450K .......... .......... .......... .......... .......... 84% 105M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78500K .......... .......... .......... .......... .......... 84% 66.1M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78550K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78600K .......... .......... .......... .......... .......... 84% 94.1M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78650K .......... .......... .......... .......... .......... 84% 78.4M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78700K .......... .......... .......... .......... .......... 84% 95.7M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78750K .......... .......... .......... .......... .......... 84% 93.1M 0s 2020-04-28T12:46:40.176 INFO:teuthology.orchestra.run.smithi092.stderr: 78800K .......... .......... .......... .......... .......... 84% 118M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 78850K .......... .......... .......... .......... .......... 84% 109M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 78900K .......... .......... .......... .......... .......... 84% 108M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 78950K .......... .......... .......... .......... .......... 85% 111M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 79000K .......... .......... .......... .......... .......... 85% 117M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 79050K .......... .......... .......... .......... .......... 85% 112M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 79100K .......... .......... .......... .......... .......... 85% 99.6M 0s 2020-04-28T12:46:40.177 INFO:teuthology.orchestra.run.smithi092.stderr: 79150K .......... .......... .......... .......... .......... 85% 95.4M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79200K .......... .......... .......... .......... .......... 85% 103M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79250K .......... .......... .......... .......... .......... 85% 111M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79300K .......... .......... .......... .......... .......... 85% 102M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79350K .......... .......... .......... .......... .......... 85% 119M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79400K .......... .......... .......... .......... .......... 85% 112M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79450K .......... .......... .......... .......... .......... 85% 117M 0s 2020-04-28T12:46:40.178 INFO:teuthology.orchestra.run.smithi092.stderr: 79500K .......... .......... .......... .......... .......... 85% 116M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79550K .......... .......... .......... .......... .......... 85% 83.1M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79600K .......... .......... .......... .......... .......... 85% 112M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79650K .......... .......... .......... .......... .......... 85% 107M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79700K .......... .......... .......... .......... .......... 85% 109M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79750K .......... .......... .......... .......... .......... 85% 119M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79800K .......... .......... .......... .......... .......... 85% 84.6M 0s 2020-04-28T12:46:40.179 INFO:teuthology.orchestra.run.smithi092.stderr: 79850K .......... .......... .......... .......... .......... 86% 108M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 79900K .......... .......... .......... .......... .......... 86% 105M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 79950K .......... .......... .......... .......... .......... 86% 84.7M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 80000K .......... .......... .......... .......... .......... 86% 123M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 80050K .......... .......... .......... .......... .......... 86% 81.5M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 80100K .......... .......... .......... .......... .......... 86% 80.8M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 80150K .......... .......... .......... .......... .......... 86% 89.1M 0s 2020-04-28T12:46:40.180 INFO:teuthology.orchestra.run.smithi092.stderr: 80200K .......... .......... .......... .......... .......... 86% 87.6M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80250K .......... .......... .......... .......... .......... 86% 117M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80300K .......... .......... .......... .......... .......... 86% 89.2M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80350K .......... .......... .......... .......... .......... 86% 81.3M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80400K .......... .......... .......... .......... .......... 86% 116M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80450K .......... .......... .......... .......... .......... 86% 108M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80500K .......... .......... .......... .......... .......... 86% 113M 0s 2020-04-28T12:46:40.181 INFO:teuthology.orchestra.run.smithi092.stderr: 80550K .......... .......... .......... .......... .......... 86% 98.6M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80600K .......... .......... .......... .......... .......... 86% 91.9M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80650K .......... .......... .......... .......... .......... 86% 101M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80700K .......... .......... .......... .......... .......... 86% 127M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80750K .......... .......... .......... .......... .......... 86% 84.8M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80800K .......... .......... .......... .......... .......... 87% 115M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80850K .......... .......... .......... .......... .......... 87% 89.6M 0s 2020-04-28T12:46:40.182 INFO:teuthology.orchestra.run.smithi092.stderr: 80900K .......... .......... .......... .......... .......... 87% 91.9M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 80950K .......... .......... .......... .......... .......... 87% 113M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81000K .......... .......... .......... .......... .......... 87% 88.9M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81050K .......... .......... .......... .......... .......... 87% 94.1M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81100K .......... .......... .......... .......... .......... 87% 67.2M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81150K .......... .......... .......... .......... .......... 87% 75.6M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81200K .......... .......... .......... .......... .......... 87% 110M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81250K .......... .......... .......... .......... .......... 87% 116M 0s 2020-04-28T12:46:40.183 INFO:teuthology.orchestra.run.smithi092.stderr: 81300K .......... .......... .......... .......... .......... 87% 57.1M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81350K .......... .......... .......... .......... .......... 87% 86.5M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81400K .......... .......... .......... .......... .......... 87% 103M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81450K .......... .......... .......... .......... .......... 87% 122M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81500K .......... .......... .......... .......... .......... 87% 112M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81550K .......... .......... .......... .......... .......... 87% 74.4M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81600K .......... .......... .......... .......... .......... 87% 93.1M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81650K .......... .......... .......... .......... .......... 87% 77.7M 0s 2020-04-28T12:46:40.184 INFO:teuthology.orchestra.run.smithi092.stderr: 81700K .......... .......... .......... .......... .......... 87% 118M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 81750K .......... .......... .......... .......... .......... 88% 74.3M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 81800K .......... .......... .......... .......... .......... 88% 108M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 81850K .......... .......... .......... .......... .......... 88% 113M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 81900K .......... .......... .......... .......... .......... 88% 119M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 81950K .......... .......... .......... .......... .......... 88% 74.5M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 82000K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T12:46:40.185 INFO:teuthology.orchestra.run.smithi092.stderr: 82050K .......... .......... .......... .......... .......... 88% 121M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82100K .......... .......... .......... .......... .......... 88% 55.9M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82150K .......... .......... .......... .......... .......... 88% 110M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82200K .......... .......... .......... .......... .......... 88% 119M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82250K .......... .......... .......... .......... .......... 88% 115M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82300K .......... .......... .......... .......... .......... 88% 62.6M 0s 2020-04-28T12:46:40.186 INFO:teuthology.orchestra.run.smithi092.stderr: 82350K .......... .......... .......... .......... .......... 88% 42.0M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82400K .......... .......... .......... .......... .......... 88% 102M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82450K .......... .......... .......... .......... .......... 88% 114M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82500K .......... .......... .......... .......... .......... 88% 66.5M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82550K .......... .......... .......... .......... .......... 88% 75.3M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82600K .......... .......... .......... .......... .......... 88% 90.9M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82650K .......... .......... .......... .......... .......... 89% 109M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82700K .......... .......... .......... .......... .......... 89% 79.1M 0s 2020-04-28T12:46:40.187 INFO:teuthology.orchestra.run.smithi092.stderr: 82750K .......... .......... .......... .......... .......... 89% 52.8M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 82800K .......... .......... .......... .......... .......... 89% 62.2M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 82850K .......... .......... .......... .......... .......... 89% 94.9M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 82900K .......... .......... .......... .......... .......... 89% 97.2M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 82950K .......... .......... .......... .......... .......... 89% 113M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 83000K .......... .......... .......... .......... .......... 89% 116M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 83050K .......... .......... .......... .......... .......... 89% 87.1M 0s 2020-04-28T12:46:40.188 INFO:teuthology.orchestra.run.smithi092.stderr: 83100K .......... .......... .......... .......... .......... 89% 82.4M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83150K .......... .......... .......... .......... .......... 89% 88.9M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83200K .......... .......... .......... .......... .......... 89% 120M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83250K .......... .......... .......... .......... .......... 89% 81.9M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83300K .......... .......... .......... .......... .......... 89% 110M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83350K .......... .......... .......... .......... .......... 89% 61.7M 0s 2020-04-28T12:46:40.189 INFO:teuthology.orchestra.run.smithi092.stderr: 83400K .......... .......... .......... .......... .......... 89% 120M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83450K .......... .......... .......... .......... .......... 89% 84.8M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83500K .......... .......... .......... .......... .......... 89% 123M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83550K .......... .......... .......... .......... .......... 89% 74.1M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83600K .......... .......... .......... .......... .......... 90% 78.5M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83650K .......... .......... .......... .......... .......... 90% 101M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83700K .......... .......... .......... .......... .......... 90% 116M 0s 2020-04-28T12:46:40.190 INFO:teuthology.orchestra.run.smithi092.stderr: 83750K .......... .......... .......... .......... .......... 90% 111M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 83800K .......... .......... .......... .......... .......... 90% 121M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 83850K .......... .......... .......... .......... .......... 90% 110M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 83900K .......... .......... .......... .......... .......... 90% 108M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 83950K .......... .......... .......... .......... .......... 90% 93.7M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 84000K .......... .......... .......... .......... .......... 90% 112M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 84050K .......... .......... .......... .......... .......... 90% 120M 0s 2020-04-28T12:46:40.191 INFO:teuthology.orchestra.run.smithi092.stderr: 84100K .......... .......... .......... .......... .......... 90% 104M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84150K .......... .......... .......... .......... .......... 90% 113M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84200K .......... .......... .......... .......... .......... 90% 88.5M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84250K .......... .......... .......... .......... .......... 90% 118M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84300K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84350K .......... .......... .......... .......... .......... 90% 84.9M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84400K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:46:40.192 INFO:teuthology.orchestra.run.smithi092.stderr: 84450K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84500K .......... .......... .......... .......... .......... 91% 130M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84550K .......... .......... .......... .......... .......... 91% 111M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84600K .......... .......... .......... .......... .......... 91% 114M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84650K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84700K .......... .......... .......... .......... .......... 91% 110M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84750K .......... .......... .......... .......... .......... 91% 93.1M 0s 2020-04-28T12:46:40.193 INFO:teuthology.orchestra.run.smithi092.stderr: 84800K .......... .......... .......... .......... .......... 91% 108M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 84850K .......... .......... .......... .......... .......... 91% 116M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 84900K .......... .......... .......... .......... .......... 91% 119M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 84950K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 85000K .......... .......... .......... .......... .......... 91% 113M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 85050K .......... .......... .......... .......... .......... 91% 116M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 85100K .......... .......... .......... .......... .......... 91% 118M 0s 2020-04-28T12:46:40.194 INFO:teuthology.orchestra.run.smithi092.stderr: 85150K .......... .......... .......... .......... .......... 91% 91.3M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85200K .......... .......... .......... .......... .......... 91% 106M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85250K .......... .......... .......... .......... .......... 91% 88.5M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85300K .......... .......... .......... .......... .......... 91% 67.0M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85350K .......... .......... .......... .......... .......... 91% 93.9M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85400K .......... .......... .......... .......... .......... 91% 120M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85450K .......... .......... .......... .......... .......... 92% 117M 0s 2020-04-28T12:46:40.195 INFO:teuthology.orchestra.run.smithi092.stderr: 85500K .......... .......... .......... .......... .......... 92% 70.4M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85550K .......... .......... .......... .......... .......... 92% 64.1M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85600K .......... .......... .......... .......... .......... 92% 107M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85650K .......... .......... .......... .......... .......... 92% 114M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85700K .......... .......... .......... .......... .......... 92% 57.9M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85750K .......... .......... .......... .......... .......... 92% 78.0M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85800K .......... .......... .......... .......... .......... 92% 109M 0s 2020-04-28T12:46:40.196 INFO:teuthology.orchestra.run.smithi092.stderr: 85850K .......... .......... .......... .......... .......... 92% 118M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 85900K .......... .......... .......... .......... .......... 92% 54.2M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 85950K .......... .......... .......... .......... .......... 92% 66.8M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 86000K .......... .......... .......... .......... .......... 92% 102M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 86050K .......... .......... .......... .......... .......... 92% 85.1M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 86100K .......... .......... .......... .......... .......... 92% 89.8M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 86150K .......... .......... .......... .......... .......... 92% 111M 0s 2020-04-28T12:46:40.197 INFO:teuthology.orchestra.run.smithi092.stderr: 86200K .......... .......... .......... .......... .......... 92% 72.2M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86250K .......... .......... .......... .......... .......... 92% 67.0M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86300K .......... .......... .......... .......... .......... 92% 99.5M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86350K .......... .......... .......... .......... .......... 93% 75.8M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86400K .......... .......... .......... .......... .......... 93% 116M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86450K .......... .......... .......... .......... .......... 93% 107M 0s 2020-04-28T12:46:40.198 INFO:teuthology.orchestra.run.smithi092.stderr: 86500K .......... .......... .......... .......... .......... 93% 84.4M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86550K .......... .......... .......... .......... .......... 93% 53.0M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86600K .......... .......... .......... .......... .......... 93% 120M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86650K .......... .......... .......... .......... .......... 93% 75.8M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86700K .......... .......... .......... .......... .......... 93% 109M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86750K .......... .......... .......... .......... .......... 93% 43.1M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86800K .......... .......... .......... .......... .......... 93% 43.6M 0s 2020-04-28T12:46:40.199 INFO:teuthology.orchestra.run.smithi092.stderr: 86850K .......... .......... .......... .......... .......... 93% 114M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 86900K .......... .......... .......... .......... .......... 93% 73.2M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 86950K .......... .......... .......... .......... .......... 93% 59.8M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 87000K .......... .......... .......... .......... .......... 93% 113M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 87050K .......... .......... .......... .......... .......... 93% 74.9M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 87100K .......... .......... .......... .......... .......... 93% 123M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 87150K .......... .......... .......... .......... .......... 93% 90.0M 0s 2020-04-28T12:46:40.200 INFO:teuthology.orchestra.run.smithi092.stderr: 87200K .......... .......... .......... .......... .......... 93% 67.7M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87250K .......... .......... .......... .......... .......... 93% 92.3M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87300K .......... .......... .......... .......... .......... 94% 94.1M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87350K .......... .......... .......... .......... .......... 94% 109M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87400K .......... .......... .......... .......... .......... 94% 114M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87450K .......... .......... .......... .......... .......... 94% 58.4M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87500K .......... .......... .......... .......... .......... 94% 99.7M 0s 2020-04-28T12:46:40.201 INFO:teuthology.orchestra.run.smithi092.stderr: 87550K .......... .......... .......... .......... .......... 94% 64.7M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87600K .......... .......... .......... .......... .......... 94% 122M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87650K .......... .......... .......... .......... .......... 94% 112M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87700K .......... .......... .......... .......... .......... 94% 102M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87750K .......... .......... .......... .......... .......... 94% 89.0M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87800K .......... .......... .......... .......... .......... 94% 114M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87850K .......... .......... .......... .......... .......... 94% 117M 0s 2020-04-28T12:46:40.202 INFO:teuthology.orchestra.run.smithi092.stderr: 87900K .......... .......... .......... .......... .......... 94% 69.8M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 87950K .......... .......... .......... .......... .......... 94% 57.3M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88000K .......... .......... .......... .......... .......... 94% 147M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88050K .......... .......... .......... .......... .......... 94% 92.0M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88100K .......... .......... .......... .......... .......... 94% 116M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88150K .......... .......... .......... .......... .......... 94% 111M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88200K .......... .......... .......... .......... .......... 94% 75.2M 0s 2020-04-28T12:46:40.203 INFO:teuthology.orchestra.run.smithi092.stderr: 88250K .......... .......... .......... .......... .......... 95% 103M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88300K .......... .......... .......... .......... .......... 95% 116M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88350K .......... .......... .......... .......... .......... 95% 73.8M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88400K .......... .......... .......... .......... .......... 95% 107M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88450K .......... .......... .......... .......... .......... 95% 101M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88500K .......... .......... .......... .......... .......... 95% 117M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88550K .......... .......... .......... .......... .......... 95% 87.6M 0s 2020-04-28T12:46:40.204 INFO:teuthology.orchestra.run.smithi092.stderr: 88600K .......... .......... .......... .......... .......... 95% 152M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88650K .......... .......... .......... .......... .......... 95% 100M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88700K .......... .......... .......... .......... .......... 95% 101M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88750K .......... .......... .......... .......... .......... 95% 88.2M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88800K .......... .......... .......... .......... .......... 95% 110M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88850K .......... .......... .......... .......... .......... 95% 121M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88900K .......... .......... .......... .......... .......... 95% 115M 0s 2020-04-28T12:46:40.205 INFO:teuthology.orchestra.run.smithi092.stderr: 88950K .......... .......... .......... .......... .......... 95% 108M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89000K .......... .......... .......... .......... .......... 95% 113M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89050K .......... .......... .......... .......... .......... 95% 114M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89100K .......... .......... .......... .......... .......... 95% 119M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89150K .......... .......... .......... .......... .......... 96% 85.8M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89200K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T12:46:40.206 INFO:teuthology.orchestra.run.smithi092.stderr: 89250K .......... .......... .......... .......... .......... 96% 110M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89300K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89350K .......... .......... .......... .......... .......... 96% 113M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89400K .......... .......... .......... .......... .......... 96% 119M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89450K .......... .......... .......... .......... .......... 96% 115M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89500K .......... .......... .......... .......... .......... 96% 111M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89550K .......... .......... .......... .......... .......... 96% 77.7M 0s 2020-04-28T12:46:40.207 INFO:teuthology.orchestra.run.smithi092.stderr: 89600K .......... .......... .......... .......... .......... 96% 119M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89650K .......... .......... .......... .......... .......... 96% 116M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89700K .......... .......... .......... .......... .......... 96% 117M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89750K .......... .......... .......... .......... .......... 96% 81.2M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89800K .......... .......... .......... .......... .......... 96% 120M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89850K .......... .......... .......... .......... .......... 96% 113M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89900K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 89950K .......... .......... .......... .......... .......... 96% 49.1M 0s 2020-04-28T12:46:40.208 INFO:teuthology.orchestra.run.smithi092.stderr: 90000K .......... .......... .......... .......... .......... 96% 105M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90050K .......... .......... .......... .......... .......... 96% 113M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90100K .......... .......... .......... .......... .......... 97% 92.7M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90150K .......... .......... .......... .......... .......... 97% 61.7M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90200K .......... .......... .......... .......... .......... 97% 95.4M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90250K .......... .......... .......... .......... .......... 97% 125M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90300K .......... .......... .......... .......... .......... 97% 110M 0s 2020-04-28T12:46:40.209 INFO:teuthology.orchestra.run.smithi092.stderr: 90350K .......... .......... .......... .......... .......... 97% 48.6M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90400K .......... .......... .......... .......... .......... 97% 114M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90450K .......... .......... .......... .......... .......... 97% 100M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90500K .......... .......... .......... .......... .......... 97% 118M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90550K .......... .......... .......... .......... .......... 97% 110M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90600K .......... .......... .......... .......... .......... 97% 92.3M 0s 2020-04-28T12:46:40.210 INFO:teuthology.orchestra.run.smithi092.stderr: 90650K .......... .......... .......... .......... .......... 97% 109M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90700K .......... .......... .......... .......... .......... 97% 73.3M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90750K .......... .......... .......... .......... .......... 97% 56.5M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90800K .......... .......... .......... .......... .......... 97% 116M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90850K .......... .......... .......... .......... .......... 97% 114M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90900K .......... .......... .......... .......... .......... 97% 117M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 90950K .......... .......... .......... .......... .......... 97% 109M 0s 2020-04-28T12:46:40.211 INFO:teuthology.orchestra.run.smithi092.stderr: 91000K .......... .......... .......... .......... .......... 98% 116M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91050K .......... .......... .......... .......... .......... 98% 73.0M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91100K .......... .......... .......... .......... .......... 98% 57.3M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91150K .......... .......... .......... .......... .......... 98% 90.6M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91200K .......... .......... .......... .......... .......... 98% 84.9M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91250K .......... .......... .......... .......... .......... 98% 100M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91300K .......... .......... .......... .......... .......... 98% 133M 0s 2020-04-28T12:46:40.212 INFO:teuthology.orchestra.run.smithi092.stderr: 91350K .......... .......... .......... .......... .......... 98% 30.1M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91400K .......... .......... .......... .......... .......... 98% 84.6M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91450K .......... .......... .......... .......... .......... 98% 33.0M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91500K .......... .......... .......... .......... .......... 98% 117M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91550K .......... .......... .......... .......... .......... 98% 43.0M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91600K .......... .......... .......... .......... .......... 98% 58.4M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91650K .......... .......... .......... .......... .......... 98% 52.3M 0s 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi092.stderr: 91700K .......... .......... .......... .......... .......... 98% 109M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 91750K .......... .......... .......... .......... .......... 98% 114M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 91800K .......... .......... .......... .......... .......... 98% 86.5M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 91850K .......... .......... .......... .......... .......... 98% 117M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 91900K .......... .......... .......... .......... .......... 98% 114M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 91950K .......... .......... .......... .......... .......... 99% 55.1M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 92000K .......... .......... .......... .......... .......... 99% 92.9M 0s 2020-04-28T12:46:40.214 INFO:teuthology.orchestra.run.smithi092.stderr: 92050K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92100K .......... .......... .......... .......... .......... 99% 96.8M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92150K .......... .......... .......... .......... .......... 99% 109M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92200K .......... .......... .......... .......... .......... 99% 115M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92250K .......... .......... .......... .......... .......... 99% 122M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92300K .......... .......... .......... .......... .......... 99% 87.6M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92350K .......... .......... .......... .......... .......... 99% 92.9M 0s 2020-04-28T12:46:40.215 INFO:teuthology.orchestra.run.smithi092.stderr: 92400K .......... .......... .......... .......... .......... 99% 88.7M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92450K .......... .......... .......... .......... .......... 99% 92.2M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92500K .......... .......... .......... .......... .......... 99% 115M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92550K .......... .......... .......... .......... .......... 99% 101M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92600K .......... .......... .......... .......... .......... 99% 114M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92650K .......... .......... .......... .......... .......... 99% 88.2M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92700K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi092.stderr: 92750K .......... .......... .......... .......... .......... 99% 89.9M 0s 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr: 92800K .......... .......... .......... .......... .......... 99% 74.6M 0s 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr: 92850K .......... .......... .......... .......... .......... 99% 75.7M 0s 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr: 92900K 100% 134G=1.0s 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr: 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28 12:46:39 (90.5 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi092.stderr: 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout:Archive: gradle-6.0.1-bin.zip 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: creating: /opt/gradle/gradle-6.0.1/ 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2020-04-28T12:46:40.218 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2020-04-28T12:46:40.219 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2020-04-28T12:46:40.220 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2020-04-28T12:46:40.221 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2020-04-28T12:46:40.222 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2020-04-28T12:46:40.223 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2020-04-28T12:46:40.228 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2020-04-28T12:46:40.228 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2020-04-28T12:46:40.228 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2020-04-28T12:46:40.229 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2020-04-28T12:46:40.230 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2020-04-28T12:46:40.231 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2020-04-28T12:46:40.232 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2020-04-28T12:46:40.232 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2020-04-28T12:46:40.233 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2020-04-28T12:46:40.236 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2020-04-28T12:46:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2020-04-28T12:46:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2020-04-28T12:46:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2020-04-28T12:46:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2020-04-28T12:46:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2020-04-28T12:46:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2020-04-28T12:46:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2020-04-28T12:46:40.264 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2020-04-28T12:46:40.264 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2020-04-28T12:46:40.273 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2020-04-28T12:46:40.273 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2020-04-28T12:46:40.273 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2020-04-28T12:46:40.273 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2020-04-28T12:46:40.273 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2020-04-28T12:46:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2020-04-28T12:46:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2020-04-28T12:46:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2020-04-28T12:46:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2020-04-28T12:46:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2020-04-28T12:46:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2020-04-28T12:46:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2020-04-28T12:46:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2020-04-28T12:46:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2020-04-28T12:46:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2020-04-28T12:46:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2020-04-28T12:46:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2020-04-28T12:46:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2020-04-28T12:46:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2020-04-28T12:46:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2020-04-28T12:46:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2020-04-28T12:46:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2020-04-28T12:46:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2020-04-28T12:46:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2020-04-28T12:46:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2020-04-28T12:46:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2020-04-28T12:46:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2020-04-28T12:46:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2020-04-28T12:46:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2020-04-28T12:46:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2020-04-28T12:46:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2020-04-28T12:46:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2020-04-28T12:46:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2020-04-28T12:46:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2020-04-28T12:46:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2020-04-28T12:46:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2020-04-28T12:46:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2020-04-28T12:46:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2020-04-28T12:46:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2020-04-28T12:46:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2020-04-28T12:46:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2020-04-28T12:46:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2020-04-28T12:46:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2020-04-28T12:46:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2020-04-28T12:46:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2020-04-28T12:46:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2020-04-28T12:46:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2020-04-28T12:46:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2020-04-28T12:46:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2020-04-28T12:46:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2020-04-28T12:46:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2020-04-28T12:46:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2020-04-28T12:46:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2020-04-28T12:46:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2020-04-28T12:46:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2020-04-28T12:46:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2020-04-28T12:46:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2020-04-28T12:46:40.328 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2020-04-28T12:46:40.329 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2020-04-28T12:46:40.342 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2020-04-28T12:46:40.343 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2020-04-28T12:46:40.343 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2020-04-28T12:46:40.344 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2020-04-28T12:46:40.344 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2020-04-28T12:46:40.344 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2020-04-28T12:46:40.345 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2020-04-28T12:46:40.345 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2020-04-28T12:46:40.345 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2020-04-28T12:46:40.346 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2020-04-28T12:46:40.363 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2020-04-28T12:46:40.363 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2020-04-28T12:46:40.363 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2020-04-28T12:46:40.364 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2020-04-28T12:46:40.365 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2020-04-28T12:46:40.366 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2020-04-28T12:46:40.374 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2020-04-28T12:46:40.376 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2020-04-28T12:46:40.380 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2020-04-28T12:46:40.380 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2020-04-28T12:46:40.381 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2020-04-28T12:46:40.381 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2020-04-28T12:46:40.382 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2020-04-28T12:46:40.382 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2020-04-28T12:46:40.384 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2020-04-28T12:46:40.392 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2020-04-28T12:46:40.394 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2020-04-28T12:46:40.395 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2020-04-28T12:46:40.396 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2020-04-28T12:46:40.396 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2020-04-28T12:46:40.397 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2020-04-28T12:46:40.397 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2020-04-28T12:46:40.399 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2020-04-28T12:46:40.403 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2020-04-28T12:46:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2020-04-28T12:46:40.405 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2020-04-28T12:46:40.408 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2020-04-28T12:46:40.410 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2020-04-28T12:46:40.411 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2020-04-28T12:46:40.417 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2020-04-28T12:46:40.420 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2020-04-28T12:46:40.426 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2020-04-28T12:46:40.431 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2020-04-28T12:46:40.434 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2020-04-28T12:46:40.435 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2020-04-28T12:46:40.443 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2020-04-28T12:46:40.445 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2020-04-28T12:46:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2020-04-28T12:46:40.452 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2020-04-28T12:46:40.460 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2020-04-28T12:46:40.462 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2020-04-28T12:46:40.463 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2020-04-28T12:46:40.467 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2020-04-28T12:46:40.472 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2020-04-28T12:46:40.501 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2020-04-28T12:46:40.503 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2020-04-28T12:46:40.504 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2020-04-28T12:46:40.505 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2020-04-28T12:46:40.506 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2020-04-28T12:46:40.506 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2020-04-28T12:46:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2020-04-28T12:46:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2020-04-28T12:46:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2020-04-28T12:46:40.510 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2020-04-28T12:46:40.510 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2020-04-28T12:46:40.511 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2020-04-28T12:46:40.512 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2020-04-28T12:46:40.513 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2020-04-28T12:46:40.513 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2020-04-28T12:46:40.514 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2020-04-28T12:46:40.514 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2020-04-28T12:46:40.515 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2020-04-28T12:46:40.515 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2020-04-28T12:46:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2020-04-28T12:46:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2020-04-28T12:46:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2020-04-28T12:46:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2020-04-28T12:46:40.517 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2020-04-28T12:46:40.518 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2020-04-28T12:46:40.522 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2020-04-28T12:46:40.523 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2020-04-28T12:46:40.524 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2020-04-28T12:46:40.524 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2020-04-28T12:46:40.524 INFO:teuthology.orchestra.run.smithi092.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2020-04-28T12:46:40.564 INFO:teuthology.orchestra.run.smithi092.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2020-04-28T12:46:47.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.087 INFO:teuthology.orchestra.run.smithi092.stdout:Welcome to Gradle 6.0.1! 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout:Here are the highlights of this release: 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout: - Substantial improvements in dependency management, including 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout: - Advanced control of transitive versions 2020-04-28T12:46:47.088 INFO:teuthology.orchestra.run.smithi092.stdout: - Support for optional features and dependencies 2020-04-28T12:46:47.089 INFO:teuthology.orchestra.run.smithi092.stdout: - Rules to tweak published metadata 2020-04-28T12:46:47.089 INFO:teuthology.orchestra.run.smithi092.stdout: - Support for Java 13 2020-04-28T12:46:47.089 INFO:teuthology.orchestra.run.smithi092.stdout: - Faster incremental Java and Groovy compilation 2020-04-28T12:46:47.089 INFO:teuthology.orchestra.run.smithi092.stdout: - New Zinc compiler for Scala 2020-04-28T12:46:47.090 INFO:teuthology.orchestra.run.smithi092.stdout: - VS2019 support 2020-04-28T12:46:47.090 INFO:teuthology.orchestra.run.smithi092.stdout: - Support for Gradle Enterprise plugin 3.0 2020-04-28T12:46:47.092 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout:------------------------------------------------------------ 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout:Gradle 6.0.1 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout:------------------------------------------------------------ 2020-04-28T12:46:47.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout:Build time: 2019-11-18 20:25:01 UTC 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout:Kotlin: 1.3.50 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout:Groovy: 2.5.8 2020-04-28T12:46:47.094 INFO:teuthology.orchestra.run.smithi092.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2020-04-28T12:46:47.095 INFO:teuthology.orchestra.run.smithi092.stdout:JVM: 1.8.0_252 (Oracle Corporation 25.252-b09) 2020-04-28T12:46:47.095 INFO:teuthology.orchestra.run.smithi092.stdout:OS: Linux 4.18.0-147.8.1.el8_1.x86_64 amd64 2020-04-28T12:46:47.095 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.096 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2020-04-28T12:46:47.096 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:46:47.097 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi138.front.sepia.ceph.com 2020-04-28T12:46:47.098 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:46:47.098 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi092.front.sepia.ceph.com 2020-04-28T12:46:47.099 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2020-04-28T12:46:47.311 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2020-04-28T12:46:47.311 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2020-04-28T12:46:47.312 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'MVZXYDJIQGJUDHFPUMNI', 's3dir': 'folder', 'endpoint': 'smithi092.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': 'aTqbP5uBNlWL0gSvClA/7iwXS+ucenkDaAGWTTQRP7r6aFh2mxpLeQ==', 'host': 'smithi092.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2020-04-28T12:46:47.312 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2020-04-28T12:46:47.312 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'MVZXYDJIQGJUDHFPUMNI', '--secret', 'aTqbP5uBNlWL0gSvClA/7iwXS+ucenkDaAGWTTQRP7r6aFh2mxpLeQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2020-04-28T12:46:47.312 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:47.327 INFO:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key MVZXYDJIQGJUDHFPUMNI --secret aTqbP5uBNlWL0gSvClA/7iwXS+ucenkDaAGWTTQRP7r6aFh2mxpLeQ== --email tester.client.0_test@test.test --cluster ceph 2020-04-28T12:46:47.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.411+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.417 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.413+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.413+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.414+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.414+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.415+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.415+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.420 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.416+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.432+0000 7f23a5337180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:46:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.432+0000 7f23a5337180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:46:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.432+0000 7f23a5337180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:46:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.432+0000 7f23a5337180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:46:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.432+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.438 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.433+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.438 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.433+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.439 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.433+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:47.439 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.433+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.439 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.439 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.439 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.434+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.435+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.440 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.435+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.435+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.441 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.435+0000 7f2392b1f700 0 -- 172.21.15.92:0/1190362995 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x55eb4e96cda0 msgr2=0x55eb4e96f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.435+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 20 zonegroup default 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 10 Cannot find current period zone using local zone 2020-04-28T12:46:47.442 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.436+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.437+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.437+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.437+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.443 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.437+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.438+0000 7f23a5337180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:47.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.438+0000 7f23a5337180 20 zone default found 2020-04-28T12:46:47.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.438+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.444 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.438+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.445 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.438+0000 7f23a5337180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.445 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.439+0000 7f23a5337180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.445 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.439+0000 7f23a5337180 20 started sync module instance, tier type = 2020-04-28T12:46:47.445 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.439+0000 7f23a5337180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:46:47.454 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.450+0000 7f2392b1f700 0 -- 172.21.15.92:0/1190362995 >> [v2:172.21.15.138:6808/22963,v1:172.21.15.138:6809/22963] conn(0x7f238400c900 msgr2=0x7f238401fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:46:47.456 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=0 2020-04-28T12:46:47.456 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=1 2020-04-28T12:46:47.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=2 2020-04-28T12:46:47.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=3 2020-04-28T12:46:47.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=4 2020-04-28T12:46:47.457 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.452+0000 7f23a5337180 20 add_watcher() i=5 2020-04-28T12:46:47.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.453+0000 7f23a5337180 20 add_watcher() i=6 2020-04-28T12:46:47.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.453+0000 7f23a5337180 20 add_watcher() i=7 2020-04-28T12:46:47.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.453+0000 7f23a5337180 2 all 8 watchers are set, enabling cache 2020-04-28T12:46:47.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.454+0000 7f23a5337180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:46:47.458 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.454+0000 7f23a5337180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:46:47.459 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.454+0000 7f2363fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f22d27fc700 20 reqs_thread_entry: start 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f22cbfff700 20 reqs_thread_entry: start 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 20 init_complete bucket index max shards: 1999 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f22ca7fc700 20 reqs_thread_entry: start 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 20 get_system_obj_state: rctx=0x7ffd38c95e08 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55eb4e83b170 s->prefetch_data=0 2020-04-28T12:46:47.515 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2020-04-28T12:46:47.516 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2020-04-28T12:46:47.516 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:46:47.516 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 20 get_system_obj_state: rctx=0x7ffd38c95e18 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55eb4e83b170 s->prefetch_data=0 2020-04-28T12:46:47.516 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.510+0000 7f23a5337180 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2020-04-28T12:46:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2020-04-28T12:46:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:46:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 20 get_system_obj_state: rctx=0x7ffd38c95e18 obj=default.rgw.meta:users.keys:MVZXYDJIQGJUDHFPUMNI state=0x55eb4e83b170 s->prefetch_data=0 2020-04-28T12:46:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 cache get: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI : miss 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI info.flags=0x0 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 adding default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI to cache LRU end 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 20 get_system_obj_state: rctx=0x7ffd38c95828 obj=default.rgw.meta:users.keys:MVZXYDJIQGJUDHFPUMNI state=0x55eb4e83b170 s->prefetch_data=0 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.511+0000 7f23a5337180 10 cache get: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI : type miss (requested=0x6, cached=0x0) 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI info.flags=0x0 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 10 moving default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI to cache LRU end 2020-04-28T12:46:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 20 get_system_obj_state: rctx=0x7ffd38c95b18 obj=default.rgw.meta:users.keys:MVZXYDJIQGJUDHFPUMNI state=0x55eb4e83b170 s->prefetch_data=0 2020-04-28T12:46:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 10 cache get: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI : type miss (requested=0x6, cached=0x0) 2020-04-28T12:46:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI info.flags=0x0 2020-04-28T12:46:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.512+0000 7f23a5337180 10 moving default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI to cache LRU end 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f23a5337180 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f23a5337180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f2378ff9700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94469124234112 notifier 4941 bl.length()=632 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f2378ff9700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:46:47.520 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.514+0000 7f2378ff9700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:46:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.516+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:46:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.516+0000 7f23a5337180 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:46:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.516+0000 7f23a5337180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2020-04-28T12:46:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.517+0000 7f2378ff9700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94469124226336 notifier 4941 bl.length()=200 2020-04-28T12:46:47.521 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.517+0000 7f2378ff9700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:46:47.522 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.517+0000 7f2378ff9700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:46:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f23a5337180 10 cache put: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI info.flags=0x7 2020-04-28T12:46:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f23a5337180 10 moving default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI to cache LRU end 2020-04-28T12:46:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f23a5337180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=189 2020-04-28T12:46:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f2378ff9700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94469124230560 notifier 4941 bl.length()=189 2020-04-28T12:46:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f2378ff9700 10 cache put: name=default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI info.flags=0x7 2020-04-28T12:46:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.519+0000 7f2378ff9700 10 moving default.rgw.meta+users.keys+MVZXYDJIQGJUDHFPUMNI to cache LRU end 2020-04-28T12:46:47.524 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "user_id": "tester.client.0", 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "display_name": "Ms. tester.client.0", 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "email": "tester.client.0_test@test.test", 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "suspended": 0, 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "max_buckets": 1000, 2020-04-28T12:46:47.525 INFO:teuthology.orchestra.run.smithi092.stdout: "subusers": [], 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: "keys": [ 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: "user": "tester.client.0", 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: "access_key": "MVZXYDJIQGJUDHFPUMNI", 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: "secret_key": "aTqbP5uBNlWL0gSvClA/7iwXS+ucenkDaAGWTTQRP7r6aFh2mxpLeQ==" 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2020-04-28T12:46:47.526 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "swift_keys": [], 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": [], 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "op_mask": "read, write, delete", 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_placement": "", 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_storage_class": "", 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "placement_tags": [], 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "bucket_quota": { 2020-04-28T12:46:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "user_quota": { 2020-04-28T12:46:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": false, 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "check_on_raw": false, 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size": -1, 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max_size_kb": 0, 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max_objects": -1 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "temp_url_keys": [], 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "rgw", 2020-04-28T12:46:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: "mfa_ids": [] 2020-04-28T12:46:47.530 INFO:teuthology.orchestra.run.smithi092.stdout:} 2020-04-28T12:46:47.530 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:46:47.530 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.520+0000 7f2363fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:47.531 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.522+0000 7f23a5337180 20 remove_watcher() i=0 2020-04-28T12:46:47.531 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.522+0000 7f23a5337180 2 removed watcher, disabling cache 2020-04-28T12:46:47.531 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.523+0000 7f23a5337180 20 remove_watcher() i=1 2020-04-28T12:46:47.531 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.525+0000 7f23a5337180 20 remove_watcher() i=2 2020-04-28T12:46:47.531 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.526+0000 7f23a5337180 20 remove_watcher() i=3 2020-04-28T12:46:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.527+0000 7f23a5337180 20 remove_watcher() i=4 2020-04-28T12:46:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.529+0000 7f23a5337180 20 remove_watcher() i=5 2020-04-28T12:46:47.534 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.530+0000 7f23a5337180 20 remove_watcher() i=6 2020-04-28T12:46:47.536 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.532+0000 7f23a5337180 20 remove_watcher() i=7 2020-04-28T12:46:47.541 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:47.555 INFO:teuthology.orchestra.run.smithi092:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2020-04-28T12:46:47.645 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2020-04-28T12:46:47.646 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:47.694 INFO:teuthology.orchestra.run.smithi092:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2020-04-28T12:46:47.752 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:47.806 INFO:teuthology.orchestra.run.smithi092:> radosgw-admin gc process --include-all 2020-04-28T12:46:47.885 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.881+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.883+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.883+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.887 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.883+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.883+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.884+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.888 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.884+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.889 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.884+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:46:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:46:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:46:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:46:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.898+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.899+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.899+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.899+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.899+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:46:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.900+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.907 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.907 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.907 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 zonegroup default 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.901+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 10 Cannot find current period zone using local zone 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.902+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.903+0000 7f5c21ca4180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.903+0000 7f5c21ca4180 20 zone default found 2020-04-28T12:46:47.909 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.903+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.903+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.903+0000 7f5c21ca4180 20 rados->read ofs=0 len=0 2020-04-28T12:46:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.904+0000 7f5c21ca4180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:47.910 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.904+0000 7f5c21ca4180 20 started sync module instance, tier type = 2020-04-28T12:46:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.904+0000 7f5c21ca4180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:46:47.911 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.906+0000 7f5c0f48c700 0 -- 172.21.15.92:0/2744335988 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x562e66863a40 msgr2=0x562e66865ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=0 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=1 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=2 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=3 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=4 2020-04-28T12:46:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=5 2020-04-28T12:46:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.915+0000 7f5c21ca4180 20 add_watcher() i=6 2020-04-28T12:46:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.916+0000 7f5c21ca4180 20 add_watcher() i=7 2020-04-28T12:46:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.916+0000 7f5c21ca4180 2 all 8 watchers are set, enabling cache 2020-04-28T12:46:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.916+0000 7f5c21ca4180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:46:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.916+0000 7f5c21ca4180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:46:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.916+0000 7f5b63fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:47.918+0000 7f5c0f48c700 0 -- 172.21.15.92:0/2340939741 >> v2:172.21.15.92:3300/0 conn(0x562e668a57d0 msgr2=0x562e6689cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:46:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.119+0000 7f5c0f48c700 0 --2- 172.21.15.92:0/2340939741 >> v2:172.21.15.92:3300/0 conn(0x562e668a57d0 0x562e6689cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-28T12:46:48.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.171+0000 7f5b4e7fc700 20 reqs_thread_entry: start 2020-04-28T12:46:48.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.171+0000 7f5b47fff700 20 reqs_thread_entry: start 2020-04-28T12:46:48.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.171+0000 7f5c21ca4180 20 init_complete bucket index max shards: 1999 2020-04-28T12:46:48.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.171+0000 7f5b467fc700 20 reqs_thread_entry: start 2020-04-28T12:46:48.176 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.171+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:46:48.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.173+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.174+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.174+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.174+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.108', time=2020-04-28T14:46:20.391986+0000, chain.objs.size()=1 2020-04-28T12:46:48.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.174+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.q7JEfDy0UsV9Lwbgg5EgKJHiWuiAKpe_0 2020-04-28T12:46:48.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.176+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.178+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:46:48.184 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.180+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.181+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.185 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.181+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.186 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.182+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:46:48.188 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.184+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.185+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.55', time=2020-04-28T14:46:16.707740+0000, chain.objs.size()=4 2020-04-28T12:46:48.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4__multipart_foo.2~WYgYqPCWaWhfVKiGszJHCsxOhsPv7lc.1 2020-04-28T12:46:48.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4__multipart_foo.2~WYgYqPCWaWhfVKiGszJHCsxOhsPv7lc.2 2020-04-28T12:46:48.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4__multipart_foo.2~WYgYqPCWaWhfVKiGszJHCsxOhsPv7lc.3 2020-04-28T12:46:48.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.186+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.4__multipart_foo.2~WYgYqPCWaWhfVKiGszJHCsxOhsPv7lc.4 2020-04-28T12:46:48.193 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.189+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.195 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.191+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:46:48.197 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.193+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.198 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.194+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.195+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.196+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:46:48.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.198+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.198+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_9K5k6M7R7WviNHN29rVo4A5aaYuvNQC', time=2020-04-28T14:46:22.188929+0000, chain.objs.size()=2 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.rViQAYuKTr64iPEGlXJmCuEX2jQSPXQ_0 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.rViQAYuKTr64iPEGlXJmCuEX2jQSPXQ_1 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.204', time=2020-04-28T14:46:23.876252+0000, chain.objs.size()=3 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-LUKEWARM.2~ts3zykSxEqGe93Qk0EpqY32P0PQKSaz.1 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-LUKEWARM.2~ts3zykSxEqGe93Qk0EpqY32P0PQKSaz.2 2020-04-28T12:46:48.204 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.199+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-LUKEWARM.2~ts3zykSxEqGe93Qk0EpqY32P0PQKSaz.3 2020-04-28T12:46:48.207 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.203+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.206+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:46:48.212 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.208+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.208+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.209+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.210+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:46:48.216 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.212+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.116', time=2020-04-28T14:46:20.430814+0000, chain.objs.size()=1 2020-04-28T12:46:48.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.4YMHicnECsXH5ocydvLtyT2wAYAlpib_1 2020-04-28T12:46:48.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.226', time=2020-04-28T14:46:22.207227+0000, chain.objs.size()=3 2020-04-28T12:46:48.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.1 2020-04-28T12:46:48.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.213+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.2 2020-04-28T12:46:48.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.214+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.3 2020-04-28T12:46:48.219 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.215+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.222 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.218+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:46:48.224 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.220+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.225 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_NF0p7m7nWcEdFQ0xdR-SGLgcR2859V2', time=2020-04-28T14:46:20.423551+0000, chain.objs.size()=1 2020-04-28T12:46:48.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.jJ9Z4YBGGHMN0OOLx_pzEgdF-dtDu_5_0 2020-04-28T12:46:48.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.236', time=2020-04-28T14:46:22.143688+0000, chain.objs.size()=3 2020-04-28T12:46:48.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.1 2020-04-28T12:46:48.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.2 2020-04-28T12:46:48.226 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.221+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.3 2020-04-28T12:46:48.229 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.223+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.231 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.227+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:46:48.233 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.229+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.246', time=2020-04-28T14:46:22.182930+0000, chain.objs.size()=3 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.1 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.2 2020-04-28T12:46:48.236 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.3 2020-04-28T12:46:48.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.197', time=2020-04-28T14:46:23.882439+0000, chain.objs.size()=3 2020-04-28T12:46:48.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-FROZEN.2~Y2tTkDncKP3NfxiiqFjKh4sq6MqEJES.1 2020-04-28T12:46:48.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-FROZEN.2~Y2tTkDncKP3NfxiiqFjKh4sq6MqEJES.2 2020-04-28T12:46:48.237 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.230+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-FROZEN.2~Y2tTkDncKP3NfxiiqFjKh4sq6MqEJES.3 2020-04-28T12:46:48.238 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.234+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.242 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.237+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:46:48.243 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.239+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.244 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.240+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.245 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.240+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.245 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.240+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_LZJDJFISqYNgYV7ISjPemdd-ZcUuRzZ', time=2020-04-28T14:46:20.438418+0000, chain.objs.size()=1 2020-04-28T12:46:48.245 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.240+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.ih2blqK4y9AxVD-aJBlGI_jX5GkcBM3_0 2020-04-28T12:46:48.247 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.243+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.255 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.246+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:46:48.255 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.248+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.255 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.249+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.255 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.249+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.255 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.249+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.85', time=2020-04-28T14:46:25.540931+0000, chain.objs.size()=2 2020-04-28T12:46:48.256 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.249+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6__shadow_.e9tzbgimuRpgYFTExquc5jmz9NtnCVs_0 2020-04-28T12:46:48.256 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.249+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6__shadow_.e9tzbgimuRpgYFTExquc5jmz9NtnCVs_1 2020-04-28T12:46:48.256 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.251+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.258 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.254+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:46:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.256+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.112', time=2020-04-28T14:46:20.373107+0000, chain.objs.size()=1 2020-04-28T12:46:48.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.9Vkzap6LuRQeGcmwvtBkf5DtVRO7fco_0 2020-04-28T12:46:48.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.114', time=2020-04-28T14:46:20.379457+0000, chain.objs.size()=1 2020-04-28T12:46:48.262 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.257+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.9Vkzap6LuRQeGcmwvtBkf5DtVRO7fco_0 2020-04-28T12:46:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.261+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.264+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:46:48.270 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.266+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.271 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.267+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.267+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.267+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.234', time=2020-04-28T14:46:22.137111+0000, chain.objs.size()=3 2020-04-28T12:46:48.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.267+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.1 2020-04-28T12:46:48.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.268+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.2 2020-04-28T12:46:48.272 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.268+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-LUKEWARM.2~rQcACwyChEHKM9y-x4wNDfK3-AI-r5b.3 2020-04-28T12:46:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.268+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_fSb6aexyg2XEyFjhrLikmN-QEmPKCL9', time=2020-04-28T14:46:22.169402+0000, chain.objs.size()=2 2020-04-28T12:46:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.268+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.ysdN8ESIoM2VIQMqxHdKD5q1cOZRbGu_0 2020-04-28T12:46:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.268+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.ysdN8ESIoM2VIQMqxHdKD5q1cOZRbGu_1 2020-04-28T12:46:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.271+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.274+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:46:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.276+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:46:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_UBAfvmc_tDyxZzqpQR35rlreuMgBMIc', time=2020-04-28T14:46:20.398056+0000, chain.objs.size()=1 2020-04-28T12:46:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.PxALzs0ZAMxDTs3LB6k2IvVBadtRwQc_0 2020-04-28T12:46:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_K0tsNG0B9_cI3z1a_3Rc-7Xl5tG3WwI', time=2020-04-28T14:46:20.411030+0000, chain.objs.size()=1 2020-04-28T12:46:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.277+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_._eV0MhE1Z_oJkZDkvQDjFKqUmW9rSRd_1 2020-04-28T12:46:48.283 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.279+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.286 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.282+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:46:48.288 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.284+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.71', time=2020-04-28T14:46:18.672440+0000, chain.objs.size()=4 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5__multipart_foo.2~0l2hKWi2iYnIApkv5y_FM-W7EWIw4Vp.1 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5__multipart_foo.2~0l2hKWi2iYnIApkv5y_FM-W7EWIw4Vp.2 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5__multipart_foo.2~0l2hKWi2iYnIApkv5y_FM-W7EWIw4Vp.3 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.5__multipart_foo.2~0l2hKWi2iYnIApkv5y_FM-W7EWIw4Vp.4 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_di_IRlFkefcKEINUSwxL2vVcileROLj', time=2020-04-28T14:46:20.403855+0000, chain.objs.size()=1 2020-04-28T12:46:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.XzntgYFGqlTg63WvpYQk11VeCrjbVa9_0 2020-04-28T12:46:48.291 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_aPklLWJpskaCcx29IwjVEf3tx6SsBHU', time=2020-04-28T14:46:22.162540+0000, chain.objs.size()=1 2020-04-28T12:46:48.291 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.285+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.JgPqOFPkgK796OS_4edSEGBZfeIoiEA_0 2020-04-28T12:46:48.292 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.288+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.291+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:46:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.293+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.299 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.294+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.20', time=2020-04-28T14:46:13.322162+0000, chain.objs.size()=4 2020-04-28T12:46:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2__multipart_foo.2~4ttFGFtlLWK3WvivfDf2sqfcsMfiMFn.1 2020-04-28T12:46:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2__multipart_foo.2~4ttFGFtlLWK3WvivfDf2sqfcsMfiMFn.2 2020-04-28T12:46:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2__multipart_foo.2~4ttFGFtlLWK3WvivfDf2sqfcsMfiMFn.3 2020-04-28T12:46:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.295+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.2__multipart_foo.2~4ttFGFtlLWK3WvivfDf2sqfcsMfiMFn.4 2020-04-28T12:46:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.298+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.306 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.302+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:46:48.307 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.303+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.308 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.304+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.309 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.304+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.309 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.304+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.109', time=2020-04-28T14:46:20.444444+0000, chain.objs.size()=1 2020-04-28T12:46:48.310 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.304+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.q7JEfDy0UsV9Lwbgg5EgKJHiWuiAKpe_0 2020-04-28T12:46:48.311 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.307+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.314 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.310+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:46:48.316 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.311+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.316 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.312+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.317 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.313+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.317 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.313+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.119', time=2020-04-28T14:46:20.417402+0000, chain.objs.size()=1 2020-04-28T12:46:48.318 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.313+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_.4YMHicnECsXH5ocydvLtyT2wAYAlpib_1 2020-04-28T12:46:48.319 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.315+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.321 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.317+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:46:48.323 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.319+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.324 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.320+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.320+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.320+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_OBv5PZ3GAaJ85sGAzI7lVMEtgpPgZIU', time=2020-04-28T14:46:22.175870+0000, chain.objs.size()=2 2020-04-28T12:46:48.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.320+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.bjmDnbZaoN0-l4UbIDYKdM0AiQJidzO_1 2020-04-28T12:46:48.325 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.320+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.bjmDnbZaoN0-l4UbIDYKdM0AiQJidzO_2 2020-04-28T12:46:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.322+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.329 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.325+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:46:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.327+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.332 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.328+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.328+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.335 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.330+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:46:48.336 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.331+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.337 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.332+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.339 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.332+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.340 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.334+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:46:48.340 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.336+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.341 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.337+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.342 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.338+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.343 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.339+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:46:48.345 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.341+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.345 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.341+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:46:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.40', time=2020-04-28T14:46:15.004633+0000, chain.objs.size()=4 2020-04-28T12:46:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3__multipart_foo.2~MKu2mA68nuDdGriXCrAbwpT89LJWZN4.1 2020-04-28T12:46:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3__multipart_foo.2~MKu2mA68nuDdGriXCrAbwpT89LJWZN4.2 2020-04-28T12:46:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3__multipart_foo.2~MKu2mA68nuDdGriXCrAbwpT89LJWZN4.3 2020-04-28T12:46:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.3__multipart_foo.2~MKu2mA68nuDdGriXCrAbwpT89LJWZN4.4 2020-04-28T12:46:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.225', time=2020-04-28T14:46:22.156194+0000, chain.objs.size()=3 2020-04-28T12:46:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.1 2020-04-28T12:46:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.2 2020-04-28T12:46:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-FROZEN.2~3rZtfcQHTzcYcPmTyGaiGhW4osYN251.3 2020-04-28T12:46:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_9smB4Rv9X6BVnqPOuirXg51GnR7WyZT', time=2020-04-28T14:46:22.201511+0000, chain.objs.size()=1 2020-04-28T12:46:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.342+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.mlM1PrnI-Ypco9wvWPTEUxgXTiMDghr_0 2020-04-28T12:46:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.347+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.350+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:46:48.356 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.352+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.357 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.353+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.358 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.354+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.358 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.354+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_a5e5aO7E4E2dRVO34I1WIz1txWsWuWA', time=2020-04-28T14:46:22.150030+0000, chain.objs.size()=2 2020-04-28T12:46:48.359 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.354+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.vy5XKSnBZO024Q83U1-peRrv_Pg45eR_1 2020-04-28T12:46:48.359 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.354+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__shadow_.vy5XKSnBZO024Q83U1-peRrv_Pg45eR_2 2020-04-28T12:46:48.360 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.356+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.359+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:46:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.361+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.361+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.362+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.362+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='_gJk7MyoFh35upv4TcIm0as-uTCcmmPq', time=2020-04-28T14:46:20.386054+0000, chain.objs.size()=1 2020-04-28T12:46:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.362+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.7__shadow_._g6FkL_39-JRp9Xx6B9EVHBl4cM_bz9_1 2020-04-28T12:46:48.368 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.364+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.372 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.368+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:46:48.373 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.369+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.374 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.370+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.375 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.370+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.376 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.372+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:46:48.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.374+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.378 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.374+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.211', time=2020-04-28T14:46:23.889154+0000, chain.objs.size()=3 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-STANDARD.2~jl-Z92bfs6KALZyhZvaUFpSoQ9hqNwm.1 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-STANDARD.2~jl-Z92bfs6KALZyhZvaUFpSoQ9hqNwm.2 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.8__multipart_foo-STANDARD.2~jl-Z92bfs6KALZyhZvaUFpSoQ9hqNwm.3 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.84', time=2020-04-28T14:46:25.547297+0000, chain.objs.size()=2 2020-04-28T12:46:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6__shadow_.DSFnCHgGaDt3atpKSc8uw4xLgSj3fqP_0 2020-04-28T12:46:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6__shadow_.DSFnCHgGaDt3atpKSc8uw4xLgSj3fqP_1 2020-04-28T12:46:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.86', time=2020-04-28T14:46:25.554065+0000, chain.objs.size()=1 2020-04-28T12:46:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.375+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.6__shadow_.pcRZjrEYbKn5PY7shv258DDhTO1EsJk_1 2020-04-28T12:46:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.380+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.387 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.383+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:46:48.389 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.385+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.386+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.386+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.387+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:46:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.389+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.394 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.390+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.390+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.397 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.392+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:46:48.398 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.394+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.398 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.394+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.395+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:46:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.395+0000 7f5c21ca4180 20 garbage collection: RGWGC::process iterating over entry tag='de5031a7-756e-4627-80ed-dffcaeda1dfb.4382.243', time=2020-04-28T14:46:22.195023+0000, chain.objs.size()=3 2020-04-28T12:46:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.395+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.1 2020-04-28T12:46:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.395+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.2 2020-04-28T12:46:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.395+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de5031a7-756e-4627-80ed-dffcaeda1dfb.4668.9__multipart_foo-STANDARD.2~PhD2jDVTE0pGA7ZSVLJAlZSfablKesb.3 2020-04-28T12:46:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.398+0000 7f5c21ca4180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:46:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.401+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:46:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.402+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.407 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.403+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.408 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.404+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.405+0000 7f5c21ca4180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:46:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.407+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.407+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.408+0000 7f5c21ca4180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.409+0000 7f5b63fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:48.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.411+0000 7f5c21ca4180 20 remove_watcher() i=0 2020-04-28T12:46:48.415 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.411+0000 7f5c21ca4180 2 removed watcher, disabling cache 2020-04-28T12:46:48.417 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.413+0000 7f5c21ca4180 20 remove_watcher() i=1 2020-04-28T12:46:48.418 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.414+0000 7f5c21ca4180 20 remove_watcher() i=2 2020-04-28T12:46:48.419 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.415+0000 7f5c21ca4180 20 remove_watcher() i=3 2020-04-28T12:46:48.421 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.417+0000 7f5c21ca4180 20 remove_watcher() i=4 2020-04-28T12:46:48.422 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.418+0000 7f5c21ca4180 20 remove_watcher() i=5 2020-04-28T12:46:48.423 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.419+0000 7f5c21ca4180 20 remove_watcher() i=6 2020-04-28T12:46:48.425 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.421+0000 7f5c21ca4180 20 remove_watcher() i=7 2020-04-28T12:46:48.429 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:48.486 INFO:teuthology.orchestra.run.smithi092:> radosgw-admin gc process --include-all 2020-04-28T12:46:48.566 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.561+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.567 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.563+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.567 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.563+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.568 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.564+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.568 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.564+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.568 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.564+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.568 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.564+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.569 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.565+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:48.786 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 RGWRados::pool_iterate: got zone_info.de5031a7-756e-4627-80ed-dffcaeda1dfb 2020-04-28T12:46:48.786 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 RGWRados::pool_iterate: got zonegroup_info.a46c5819-dac8-4e1f-b625-b8664bf72489 2020-04-28T12:46:48.787 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:46:48.787 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:46:48.787 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.787 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:48.787 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.782+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.788 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.783+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.783+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.783+0000 7fc48ebe6700 0 -- 172.21.15.92:0/3432735796 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x5567ef0b7930 msgr2=0x5567ef0b9db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.783+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.783+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.789 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.790 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:46:48.790 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.790 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.795 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.784+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.785+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.785+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.785+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.785+0000 7fc4a13fe180 20 zonegroup default 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.785+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 10 Cannot find current period zone using local zone 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.786+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.787+0000 7fc4a13fe180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.787+0000 7fc4a13fe180 20 zone default found 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.787+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.787+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.787+0000 7fc4a13fe180 20 rados->read ofs=0 len=0 2020-04-28T12:46:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.788+0000 7fc4a13fe180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:46:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.788+0000 7fc4a13fe180 20 started sync module instance, tier type = 2020-04-28T12:46:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.788+0000 7fc4a13fe180 20 started zone id=de5031a7-756e-4627-80ed-dffcaeda1dfb (name=default) with tier type = 2020-04-28T12:46:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.795+0000 7fc48ebe6700 0 -- 172.21.15.92:0/3432735796 >> [v2:172.21.15.92:6810/23975,v1:172.21.15.92:6811/23975] conn(0x7fc47c05df90 msgr2=0x7fc47c0603c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:46:48.806 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=0 2020-04-28T12:46:48.806 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=1 2020-04-28T12:46:48.806 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=2 2020-04-28T12:46:48.806 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=3 2020-04-28T12:46:48.807 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=4 2020-04-28T12:46:48.807 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=5 2020-04-28T12:46:48.807 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.800+0000 7fc4a13fe180 20 add_watcher() i=6 2020-04-28T12:46:48.807 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.801+0000 7fc4a13fe180 20 add_watcher() i=7 2020-04-28T12:46:48.808 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.801+0000 7fc4a13fe180 2 all 8 watchers are set, enabling cache 2020-04-28T12:46:48.808 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.801+0000 7fc4a13fe180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:46:48.808 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.801+0000 7fc4a13fe180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:46:48.808 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:48.801+0000 7fc45ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:49.062 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.057+0000 7fc3ce7fc700 20 reqs_thread_entry: start 2020-04-28T12:46:49.062 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.057+0000 7fc3c7fff700 20 reqs_thread_entry: start 2020-04-28T12:46:49.062 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.057+0000 7fc4a13fe180 20 init_complete bucket index max shards: 1999 2020-04-28T12:46:49.062 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.057+0000 7fc3c67fc700 20 reqs_thread_entry: start 2020-04-28T12:46:49.063 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.057+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:46:49.063 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.059+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.064 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.060+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.064 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.060+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.069 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.062+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:46:49.070 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.064+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.070 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.065+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.070 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.065+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.071 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.067+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:46:49.075 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.069+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.076 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.070+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.076 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.070+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.076 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.071+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:46:49.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.074+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.078 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.074+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.079 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.075+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.081 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.077+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:46:49.082 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.078+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.084 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.079+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.084 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.080+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.085 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.081+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:46:49.087 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.083+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.088 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.084+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.089 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.084+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.086+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:46:49.092 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.088+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.093 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.089+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.093 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.089+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.094 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.090+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:46:49.096 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.092+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.098 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.093+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.098 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.094+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.100 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.096+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:46:49.101 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.097+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.102 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.098+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.103 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.099+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.104 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.100+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:46:49.106 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.102+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.107 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.103+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.107 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.103+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.105+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:46:49.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.107+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.111 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.107+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.112 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.108+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.117 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.109+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:46:49.117 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.111+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.117 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.112+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.118 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.112+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.118 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.114+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:46:49.120 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.116+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.121 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.116+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.121 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.117+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.122 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.118+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:46:49.124 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.120+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.125 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.121+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.125 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.121+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.127 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.123+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:46:49.129 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.124+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.130 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.125+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.130 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.125+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.131 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.127+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:46:49.133 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.129+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.134 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.130+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.135 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.131+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.136 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.132+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:46:49.138 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.134+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.139 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.135+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.139 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.135+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.141 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.137+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:46:49.143 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.139+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.145 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.140+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.145 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.141+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.148 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.143+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:46:49.149 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.145+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.150 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.146+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.151 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.146+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.152 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.148+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:46:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.150+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.155 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.151+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.156 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.152+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.157 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.153+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:46:49.159 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.155+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.159 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.155+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.160 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.156+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.161 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.157+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:46:49.163 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.159+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.164 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.160+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.165 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.161+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.167 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.162+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:46:49.168 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.164+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.165+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.169 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.165+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.170 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.166+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:46:49.173 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.168+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.174 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.169+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.174 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.169+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.175 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.171+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:46:49.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.173+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.178 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.173+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.179 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.174+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.180 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.176+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:46:49.182 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.177+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.178+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.179+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.180+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:46:49.190 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.182+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.183+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.183+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.191 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.185+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:46:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.187+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.188+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.199 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.188+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.190+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:46:49.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.192+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.193+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.200 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.193+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.201 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.195+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:46:49.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.197+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.197+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.202 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.198+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.203 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.199+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:46:49.205 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.201+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.202+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.206 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.202+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.208 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.204+0000 7fc4a13fe180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:46:49.210 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.206+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.207+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:46:49.211 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.207+0000 7fc4a13fe180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:46:49.213 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.209+0000 7fc45ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:46:49.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.210+0000 7fc4a13fe180 20 remove_watcher() i=0 2020-04-28T12:46:49.214 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.210+0000 7fc4a13fe180 2 removed watcher, disabling cache 2020-04-28T12:46:49.215 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.211+0000 7fc4a13fe180 20 remove_watcher() i=1 2020-04-28T12:46:49.217 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.213+0000 7fc4a13fe180 20 remove_watcher() i=2 2020-04-28T12:46:49.218 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.214+0000 7fc4a13fe180 20 remove_watcher() i=3 2020-04-28T12:46:49.220 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.216+0000 7fc4a13fe180 20 remove_watcher() i=4 2020-04-28T12:46:49.221 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.217+0000 7fc4a13fe180 20 remove_watcher() i=5 2020-04-28T12:46:49.222 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.218+0000 7fc4a13fe180 20 remove_watcher() i=6 2020-04-28T12:46:49.224 INFO:teuthology.orchestra.run.smithi092.stderr:2020-04-28T12:46:49.220+0000 7fc4a13fe180 20 remove_watcher() i=7 2020-04-28T12:46:49.228 INFO:teuthology.orchestra.run.smithi092:> true 2020-04-28T12:46:49.282 INFO:teuthology.orchestra.run.smithi092:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2020-04-28T12:46:49.866 INFO:teuthology.orchestra.run.smithi092.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2020-04-28T12:46:53.767 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :clean UP-TO-DATE 2020-04-28T12:47:10.865 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :compileJava 2020-04-28T12:47:10.965 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :processResources 2020-04-28T12:47:10.966 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :classes 2020-04-28T12:47:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:11.467 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :compileTestJava 2020-04-28T12:47:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:11.468 INFO:teuthology.orchestra.run.smithi092.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2020-04-28T12:47:11.468 INFO:teuthology.orchestra.run.smithi092.stderr:Note: Recompile with -Xlint:deprecation for details. 2020-04-28T12:47:11.468 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :processTestResources NO-SOURCE 2020-04-28T12:47:11.469 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :testClasses 2020-04-28T12:47:17.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:17.366 INFO:teuthology.orchestra.run.smithi092.stdout:> Task :test 2020-04-28T12:47:17.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:17.366 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2020-04-28T12:47:18.266 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:18.266 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2020-04-28T12:47:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:20.166 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2020-04-28T12:47:20.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:20.666 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2020-04-28T12:47:22.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:22.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2020-04-28T12:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:23.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2020-04-28T12:47:25.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:25.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:47:25.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:25.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:47:25.866 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:25.866 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2020-04-28T12:47:26.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:26.366 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2020-04-28T12:47:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:28.266 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2020-04-28T12:47:29.465 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:29.466 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2020-04-28T12:47:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:33.266 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:47:37.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:37.566 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:47:41.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:41.666 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2020-04-28T12:47:42.066 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:42.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2020-04-28T12:47:44.066 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:44.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2020-04-28T12:47:45.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:45.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2020-04-28T12:47:49.265 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:49.266 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2020-04-28T12:47:50.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:50.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2020-04-28T12:47:52.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:52.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:47:52.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:52.166 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:47:52.266 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:52.266 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2020-04-28T12:47:54.966 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:54.966 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2020-04-28T12:47:56.867 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:56.867 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2020-04-28T12:47:57.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:57.666 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2020-04-28T12:47:59.765 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:47:59.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2020-04-28T12:48:00.666 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:00.666 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2020-04-28T12:48:02.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:02.666 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:48:09.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:09.166 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:48:11.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:11.166 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2020-04-28T12:48:13.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:13.066 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2020-04-28T12:48:14.965 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:14.966 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2020-04-28T12:48:15.865 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:15.866 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2020-04-28T12:48:17.765 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:17.766 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2020-04-28T12:48:18.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-04-28T12:48:18.566 INFO:teuthology.orchestra.run.smithi092.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2020-04-28T12:50:13.058 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:50:13.053+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T12:50:13.059 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:50:13.053+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T12:50:13.059 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:50:13.053+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T12:52:10.255 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T12:52:10.250+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T12:52:28.923 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:52:28.917+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T12:52:28.923 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T12:52:28.917+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T12:52:32.398 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T12:52:32.391+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:01:10.816 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:01:10.811+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:04:54.026 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:04:54.022+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:05:38.740 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:05:38.735+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:06:54.386 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:06:54.382+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:12:38.408 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:12:38.404+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:13:08.599 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:13:08.596+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:15:07.905 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:15:07.899+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T13:15:07.906 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:15:07.899+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T13:25:16.911 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T13:25:16.910+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T13:26:34.593 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T13:26:34.590+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T13:31:17.042 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T13:31:17.041+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T13:32:31.982 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:32:31.981+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:32:34.295 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:32:34.293+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:33:11.688 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:33:11.688+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:34:32.150 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:34:32.148+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:38:02.909 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T13:38:02.907+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T13:38:02.909 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T13:38:02.907+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T13:43:30.385 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:43:30.384+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:46:58.594 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:46:58.593+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:47:26.661 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:47:26.652+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:49:22.550 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:49:22.549+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T13:49:22.551 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:49:22.549+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T13:49:22.551 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:49:22.549+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T13:50:16.146 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T13:50:16.143+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T13:56:23.421 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T13:56:23.419+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T13:56:58.068 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T13:56:58.067+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T13:58:37.394 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:58:37.392+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T13:58:37.394 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T13:58:37.392+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T14:00:43.253 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:00:43.252+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T14:00:43.253 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:00:43.252+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T14:07:15.174 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:07:15.172+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T14:07:15.174 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:07:15.172+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T14:26:14.449 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T14:26:14.448+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T14:26:20.304 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T14:26:20.302+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T14:28:56.610 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:28:56.609+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T14:28:56.610 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:28:56.609+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T14:31:38.417 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T14:31:38.417+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T14:33:25.027 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T14:33:25.025+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T14:33:25.027 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T14:33:25.025+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T14:37:47.308 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T14:37:47.306+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T14:39:02.317 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T14:39:02.315+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T14:39:49.400 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T14:39:49.399+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T14:39:59.522 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:39:59.521+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T14:43:00.588 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:43:00.586+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T14:43:00.588 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T14:43:00.586+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T14:46:41.532 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T14:46:41.529+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T14:49:12.695 INFO:tasks.ceph.osd.6.smithi138.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2020-04-28T14:49:12.696 INFO:tasks.ceph.osd.7.smithi138.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2020-04-28T14:49:12.696 INFO:tasks.ceph.osd.4.smithi138.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2020-04-28T14:49:12.696 INFO:tasks.ceph.osd.5.smithi138.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2020-04-28T14:49:13.301 INFO:tasks.ceph.mon.b.smithi138.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2020-04-28T14:49:16.399 INFO:tasks.ceph.mgr.x.smithi138.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2020-04-28T14:55:28.948 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T14:55:28.946+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T14:57:54.657 INFO:tasks.ceph.osd.1.smithi092.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2020-04-28T14:57:54.658 INFO:tasks.ceph.osd.2.smithi092.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2020-04-28T14:57:54.658 INFO:tasks.ceph.osd.3.smithi092.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2020-04-28T14:57:54.658 INFO:tasks.ceph.osd.0.smithi092.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2020-04-28T14:57:54.830 INFO:tasks.rgw.client.0.smithi092.stdout:problem writing to /var/log/ceph/rgw.ceph.client.0.log: tee: /var/log/ceph/rgw.ceph.client.0.stdout: No space left on device 2020-04-28T14:57:54.830 INFO:tasks.rgw.client.0.smithi092.stdout:(28) No space left on device 2020-04-28T14:57:55.216 INFO:tasks.ceph.mgr.y.smithi092.stderr:problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2020-04-28T14:57:55.498 INFO:tasks.ceph.mon.a.smithi092.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2020-04-28T14:57:55.555 INFO:tasks.ceph.mon.c.smithi092.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2020-04-28T15:02:22.122 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T15:02:22.120+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T15:08:10.449 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:08:10.447+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:18:23.396 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T15:18:23.393+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T15:18:23.397 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T15:18:23.393+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T15:24:03.549 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:24:03.545+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T15:24:03.549 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:24:03.545+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:24:21.574 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T15:24:21.572+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T15:30:42.513 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:30:42.508+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:35:17.887 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T15:35:17.885+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T15:40:29.170 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:40:29.169+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T15:40:29.171 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:40:29.169+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:44:35.903 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T15:44:35.901+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T15:46:12.007 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T15:46:12.003+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T15:52:10.229 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:52:10.226+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T15:52:10.230 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:52:10.226+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:55:50.862 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:55:50.860+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T15:55:50.883 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:55:50.860+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T15:58:23.798 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:58:23.796+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T15:58:23.798 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T15:58:23.796+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T16:05:13.845 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:05:13.842+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T16:05:13.846 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:05:13.842+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T16:05:13.846 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:05:13.842+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T16:11:08.606 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T16:11:08.604+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T16:14:48.566 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T16:14:48.562+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T16:14:48.566 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T16:14:48.562+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T16:18:47.495 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T16:18:47.491+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T16:25:17.332 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T16:25:17.331+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T16:43:45.756 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:43:45.753+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T16:43:45.774 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:43:45.753+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T16:43:45.774 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:43:45.753+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T16:49:31.406 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:49:31.402+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T16:49:31.407 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T16:49:31.402+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T16:51:14.873 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T16:51:14.869+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T16:55:32.729 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T16:55:32.725+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T16:55:32.729 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T16:55:32.725+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T17:09:21.449 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T17:09:21.445+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T17:17:21.313 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T17:17:21.310+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T17:21:18.062 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T17:21:18.058+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T17:36:49.011 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T17:36:49.010+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T17:38:21.903 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T17:38:21.903+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T17:39:14.350 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T17:39:14.345+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T17:39:14.350 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T17:39:14.345+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T17:43:20.336 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T17:43:20.334+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T17:54:11.159 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T17:54:11.157+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T17:55:33.734 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T17:55:33.731+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T17:58:01.695 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T17:58:01.693+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T18:09:22.176 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T18:09:22.174+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T18:10:23.385 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T18:10:23.381+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T18:13:24.308 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T18:13:24.303+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T18:13:24.308 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T18:13:24.303+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T18:14:50.356 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T18:14:50.354+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T18:21:02.685 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T18:21:02.684+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T18:23:13.225 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:23:13.222+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T18:23:13.225 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:23:13.222+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T18:27:30.300 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:27:30.296+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T18:27:30.318 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:27:30.297+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T18:41:03.742 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:41:03.740+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T18:43:26.823 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:43:26.819+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T18:43:26.823 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:43:26.819+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T18:45:37.920 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T18:45:37.918+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T18:48:54.453 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T18:48:54.451+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T18:50:34.220 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T18:50:34.216+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T18:50:34.254 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T18:50:34.217+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T18:54:12.067 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:54:12.064+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T18:54:12.068 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T18:54:12.064+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T19:00:19.196 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T19:00:19.192+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T19:08:23.788 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T19:08:23.779+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T19:08:23.814 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T19:08:23.779+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T19:08:23.814 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T19:08:23.779+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T19:10:38.172 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T19:10:38.169+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T19:10:43.615 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T19:10:43.609+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T19:14:13.223 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T19:14:13.221+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T19:14:13.223 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T19:14:13.221+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T19:19:58.019 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T19:19:58.015+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T19:31:09.108 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T19:31:09.107+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T19:32:13.939 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T19:32:13.935+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T19:34:13.801 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T19:34:13.800+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T19:43:53.459 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T19:43:53.457+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T19:52:28.210 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T19:52:28.207+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T19:57:49.601 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T19:57:49.600+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:01:59.435 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T20:01:59.431+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T20:05:20.253 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:05:20.251+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:08:32.537 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:08:32.535+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T20:08:32.537 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:08:32.535+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:09:54.393 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T20:09:54.391+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T20:09:54.393 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T20:09:54.391+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T20:11:31.929 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T20:11:31.927+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T20:13:44.313 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T20:13:44.304+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T20:18:10.676 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T20:18:10.673+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T20:19:36.343 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:19:36.342+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:22:15.833 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:22:15.830+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T20:22:15.833 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:22:15.830+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:22:19.896 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:22:19.893+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:22:44.970 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:22:44.967+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:28:05.400 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:28:05.397+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:33:15.267 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T20:33:15.265+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T20:33:15.267 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T20:33:15.265+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T20:33:15.267 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T20:33:15.265+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T20:38:08.492 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:38:08.489+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:38:51.616 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:38:51.614+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:41:29.159 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:41:29.156+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:41:36.667 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:41:36.665+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:48:28.426 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T20:48:28.424+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T20:56:30.056 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:56:30.054+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T20:56:30.057 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T20:56:30.054+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T20:57:49.896 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T20:57:49.895+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:03:58.695 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:03:58.692+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:05:45.215 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:05:45.212+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:05:45.215 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:05:45.212+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:10:16.349 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T21:10:16.345+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T21:12:09.951 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:12:09.949+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:12:09.951 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:12:09.949+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:19:25.416 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:19:25.415+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:22:43.088 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:22:43.087+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:22:43.114 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:22:43.087+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:23:18.870 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:23:18.866+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:31:30.120 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:31:30.118+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:32:11.864 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:32:11.858+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:33:55.847 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:33:55.844+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:36:08.944 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:36:08.943+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:36:08.945 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:36:08.943+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:38:13.041 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:38:13.039+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:40:33.688 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T21:40:33.685+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T21:40:33.688 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T21:40:33.685+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T21:42:47.341 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T21:42:47.339+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T21:44:33.930 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:44:33.927+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:44:33.930 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:44:33.927+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T21:45:19.911 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:45:19.907+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T21:45:19.911 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T21:45:19.907+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T22:00:15.027 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:00:15.022+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T22:00:15.050 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:00:15.022+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T22:00:15.051 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:00:15.023+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T22:00:41.794 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T22:00:41.791+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T22:11:24.843 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T22:11:24.841+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-28T22:11:24.843 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T22:11:24.841+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T22:16:50.551 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:16:50.548+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T22:16:50.551 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:16:50.549+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T22:19:52.885 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T22:19:52.881+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T22:28:09.824 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:28:09.821+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T22:28:09.824 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:28:09.821+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T22:32:12.463 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-28T22:32:12.458+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-28T22:36:31.490 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:36:31.486+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T22:36:31.490 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T22:36:31.486+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T22:38:52.496 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T22:38:52.494+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T22:41:01.951 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-28T22:41:01.947+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-28T22:53:28.783 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T22:53:28.779+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T22:55:08.661 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T22:55:08.658+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T23:04:48.648 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T23:04:48.645+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T23:18:22.291 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T23:18:22.289+0000 7f3f637c4700 -1 reset not still connected to 0x561190d04ea0 2020-04-28T23:18:22.292 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T23:18:22.289+0000 7f3f637c4700 -1 reset not still connected to 0x561190d05860 2020-04-28T23:18:22.292 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T23:18:22.289+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T23:32:28.394 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T23:32:28.390+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T23:36:31.551 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-28T23:36:31.549+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-28T23:43:49.768 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T23:43:49.766+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T23:45:07.572 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T23:45:07.570+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T23:46:20.478 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T23:46:20.475+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-28T23:55:19.449 INFO:tasks.ceph.osd.5.smithi138.stderr:2020-04-28T23:55:19.438+0000 7f3f637c4700 -1 reset not still connected to 0x561193e79380 2020-04-28T23:57:31.384 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-28T23:57:31.381+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:01:02.893 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-29T00:01:02.889+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-29T00:03:57.513 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-29T00:03:57.508+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-29T00:07:33.610 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:07:33.608+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-29T00:07:33.610 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:07:33.608+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:13:28.355 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:13:28.352+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:14:07.961 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:14:07.958+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca7040 2020-04-29T00:14:07.961 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:14:07.958+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:14:38.134 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-29T00:14:38.132+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-29T00:20:24.212 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-29T00:20:24.210+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-29T00:20:47.306 INFO:tasks.ceph.osd.0.smithi092.stderr:2020-04-29T00:20:47.304+0000 7f501e5a6700 -1 reset not still connected to 0x55af973bc410 2020-04-29T00:22:49.447 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:22:49.444+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:23:18.562 INFO:tasks.ceph.osd.3.smithi092.stderr:2020-04-29T00:23:18.560+0000 7fc062beb700 -1 reset not still connected to 0x55cce68dcea0 2020-04-29T00:23:53.394 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:23:53.393+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:24:43.689 INFO:tasks.ceph.osd.1.smithi092.stderr:2020-04-29T00:24:43.687+0000 7f0486739700 -1 reset not still connected to 0x55deb1ca75f0 2020-04-29T00:26:27.107 INFO:tasks.ceph.osd.7.smithi138.stderr:2020-04-29T00:26:27.105+0000 7f1b2fe67700 -1 reset not still connected to 0x5616293b9380 2020-04-29T00:26:46.342 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-29T00:26:46.342 DEBUG:teuthology.task.console_log:Killing console logger for smithi092 2020-04-29T00:26:46.343 DEBUG:teuthology.task.console_log:Killing console logger for smithi138 2020-04-29T00:26:46.343 DEBUG:teuthology.task.console_log:Killing console logger for smithi092 2020-04-29T00:26:46.343 DEBUG:teuthology.task.console_log:Killing console logger for smithi138 2020-04-29T00:26:46.344 DEBUG:teuthology.exit:Finished running handlers