2020-04-28T12:42:28.329 INFO:root:teuthology version: 1.0.0-8b924f7 2020-04-28T12:42:28.330 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.f01fp6x8.tmp -- --verbose --lock --description rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} --name teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi --block --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045 2020-04-28T12:42:28.372 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:42:28.426 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045 branch: octopus description: rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} email: ceph-qa@ceph.io first_in_suite: false job_id: '4990045' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: octopus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 rgw max chunk size: 4194304 rgw obj stripe size: 6291456 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1999 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 lockdep: true osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 rgw: compression type: random ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: octopus sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 sleep_before_teardown: 0 suite: rgw suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_rgw_throttle.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 teuthology_branch: py2 tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.19065 2020-04-28T12:42:28.426 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-04-28T12:42:28.427 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-04-28T12:42:28.427 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-28T12:42:28.428 INFO:teuthology.task.internal:Checking packages... 2020-04-28T12:42:28.461 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a8c125c7d78f5cd973863993d258cd717ade4c99' 2020-04-28T12:42:28.462 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-28T12:42:28.462 INFO:teuthology.packaging:ref: None 2020-04-28T12:42:28.462 INFO:teuthology.packaging:tag: None 2020-04-28T12:42:28.462 INFO:teuthology.packaging:branch: octopus 2020-04-28T12:42:28.462 INFO:teuthology.packaging:sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:42:28.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-04-28T12:42:28.924 INFO:teuthology.task.internal:Found packages for ceph version 15.2.1-150.gfcb0536 2020-04-28T12:42:28.924 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-28T12:42:28.933 INFO:teuthology.task.internal:no buildpackages task found 2020-04-28T12:42:28.933 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-28T12:42:28.944 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-28T12:42:28.944 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:42:28.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:42:39.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:42:49.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:42:59.039 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:43:09.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:43:19.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:43:29.087 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:43:39.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:43:49.119 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_teuthology@teuthology', 'description': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045', 'machine_type': 'smithi'} 2020-04-28T12:43:49.137 DEBUG:teuthology.lock.ops:locked ubuntu@smithi084.front.sepia.ceph.com, ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:43:49.193 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:43:49.393 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.1 2020-04-28T12:43:49.396 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.1 2020-04-28T12:43:49.851 INFO:teuthology.orchestra.console:Power off smithi176 2020-04-28T12:43:49.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:43:49.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:49.890 INFO:teuthology.orchestra.console:Power off smithi084 2020-04-28T12:43:49.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:43:49.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:53.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:53.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:58.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:58.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:58.226 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2020-04-28T12:43:58.256 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2020-04-28T12:43:58.328 INFO:teuthology.orchestra.console:Power on smithi176 2020-04-28T12:43:58.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:43:58.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:43:58.359 INFO:teuthology.orchestra.console:Power on smithi084 2020-04-28T12:43:58.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:43:58.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:44:02.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:44:02.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:44:02.613 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2020-04-28T12:44:02.713 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2020-04-28T12:44:06.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:44:06.697 INFO:teuthology.orchestra.console:Power on for smithi176 completed 2020-04-28T12:44:06.799 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2020-04-28T12:46:37.878 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:46:46.963 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:46:56.024 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:04.149 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:05.104 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:13.207 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:14.160 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:22.294 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:23.216 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:31.379 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:32.272 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:40.435 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:49.495 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:47:58.583 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:07.667 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:16.727 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:38.288 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:38.615 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:38.908 INFO:teuthology.orchestra.run.smithi176:> hostname 2020-04-28T12:48:38.963 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2020-04-28T12:48:38.963 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.017 INFO:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts 2020-04-28T12:48:39.071 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2020-04-28T12:48:39.072 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.125 INFO:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2020-04-28T12:48:39.239 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.255 INFO:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts 2020-04-28T12:48:39.322 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.377 INFO:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts 2020-04-28T12:48:39.444 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.497 INFO:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname 2020-04-28T12:48:39.565 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:39.618 INFO:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2020-04-28T12:48:39.684 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2020-04-28T12:48:39.686 DEBUG:teuthology.parallel:result is None 2020-04-28T12:48:48.485 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:48.865 INFO:teuthology.orchestra.run.smithi084:> hostname 2020-04-28T12:48:48.889 INFO:teuthology.orchestra.run.smithi084.stdout:smithi095 2020-04-28T12:48:48.889 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:48.943 INFO:teuthology.orchestra.run.smithi084:> grep smithi095 /etc/hosts 2020-04-28T12:48:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.95 smithi095.front.sepia.ceph.com smithi095 2020-04-28T12:48:48.997 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:49.051 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-04-28T12:48:49.175 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:49.188 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi095/smithi084/g' /etc/hosts 2020-04-28T12:48:49.256 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:49.309 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.95/172.21.15.84/g' /etc/hosts 2020-04-28T12:48:49.380 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:49.434 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi095/smithi084/g' /etc/hostname 2020-04-28T12:48:49.505 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:49.557 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-04-28T12:48:49.626 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2020-04-28T12:48:49.628 DEBUG:teuthology.parallel:result is None 2020-04-28T12:48:49.748 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2020-04-28T12:48:49.749 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:48:49.764 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2020-04-28T12:48:49.765 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:48:49.780 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:48:49.781 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:49.850 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:50.017 INFO:teuthology.orchestra.run.smithi176:> uname -m 2020-04-28T12:48:50.071 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2020-04-28T12:48:50.071 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:50.127 INFO:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2020-04-28T12:48:50.180 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Linux" 2020-04-28T12:48:50.181 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8 (Core)" 2020-04-28T12:48:50.181 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2020-04-28T12:48:50.181 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:48:50.181 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8" 2020-04-28T12:48:50.181 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:48:50.182 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:48:50.182 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2020-04-28T12:48:50.182 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:48:50.182 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:48:50.182 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:48:50.183 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:48:50.184 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2020-04-28T12:48:50.201 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:48:50.202 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:50.269 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:50.453 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-04-28T12:48:50.506 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-04-28T12:48:50.507 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:50.560 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-04-28T12:48:50.618 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Linux" 2020-04-28T12:48:50.618 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8 (Core)" 2020-04-28T12:48:50.618 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2020-04-28T12:48:50.618 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:48:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:48:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:48:50.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:48:50.621 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-04-28T12:48:50.643 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-28T12:48:50.677 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNGXiaV/5kdpLNx1yyS0/Z64X24gt79knyw6+GNFCdbqAl5iBEaeSPJAv48p5xAcezn14M3rJoZphXfO7DcNFLBcCKTyz4RHC18l/MF34btOpZA9DBMFaJBOWXrI6u/Geu8v9AVunHQVlw2ZRQfMyW2pqpLZX/iGQWwxFlSxLsLDdTMk/LefcYjInpf2/EJQArCUbX1D+s+rvasuBPNYl/2YfyzrZAMaffvbMtcmHHfxKBOVexaPPAW7aR0d1nv/HXl5pxLXYS6CqDKGmzsdN4nAWHxhvq/2Wivz+CKlEw1oRrn7MTv2QCDrK4zFEGVJRMpLY5Hw1auJKweb1GGVlvO56N6T8i66i8CIZx+YF/4zork5bjs2AHeQz9EAsJ37AgIGv7CW0Ut+JwRmtnZJIFvBiwvXFhdvdvsQgs9XaV4i8BjU99ZsZG1sr3035KeFJcACzFozlhu855GKRQ9OMVKRE1Qq7Lcl6UUQP8ke8exWbI2RYyMpR9GqjvpNGnwV0= smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkTSJ2OfPO8MkiexMqJ9tT81zvoD0XQuLKCQ1pOUS7lZF4l8ISga8JStvkQlvs1BXyEFKdiZADD+YIK50qznQgpjQQygbqsRHf9CU/44JkKufj+QBf1FMaNZg27Zn5k5u9Ccjrw/g7137OZTn95WRmcCaqw4K7VVxxmb4OpLYBZJJLLNDU+Y31We+WiEC9Vhv9Do/ADNLG59j3fCYS0+vlIX82fKfJJnA9aIq0UO4v1YK671X4u6Tz0U/JCmXkb0gj7UNptRDqlR9ywlvzEG9tByAghJYZXE7iZH45G1U8MekQ3UilHf/uFJHqQM4K6C8e3576vh7DUgNSMO20KA4PFObBDDMHCKQ4Vs2r752i5bv1H9fE4ze9YDetPXiVPBFtvoA5vXhCrQtbq4TB94i0/CifoTOf+WEgVqWjRr/kuh4wFAMUTyhSU6Mhi5ol76pBS0epgfKbqbTwh0EDvlSzm2VV9og8iRtwyIQFIfTtNB2aU2gFI/Le1r4ORZq+MJU= 2020-04-28T12:48:50.678 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:48:50.731 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-28T12:48:50.741 INFO:teuthology.task.internal:Saving configuration 2020-04-28T12:48:50.764 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-28T12:48:50.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-28T12:48:50.789 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:43:49.124199', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi176.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPja2jf2NRvoGso6S9fGf5H1VIae1z/0UwmvdAYDji1g8UaYHUly1tVJmVn+RCuZzt7QRCq0/vVuY3dSBG4ck7A=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045'} 2020-04-28T12:48:50.803 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:43:49.124179', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi084.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOifAV3dIagZ3PHdMhUeGPWr1RR+xG7nA1ydNdIvkWcDJrMgXsl6mByGmH2XKO8/6EbUbdCgVPTp5OZYJixlzSU=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045'} 2020-04-28T12:48:50.803 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-28T12:48:50.814 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:48:50.814 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:48:50.815 INFO:teuthology.run_tasks:Running task console_log... 2020-04-28T12:48:50.897 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:48:50.898 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-28T12:48:50.909 INFO:teuthology.task.internal:Opening connections... 2020-04-28T12:48:50.909 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:48:50.910 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:50.982 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:48:50.983 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:48:51.052 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-28T12:48:51.063 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:51.101 INFO:teuthology.orchestra.run.smithi176:> uname -m 2020-04-28T12:48:51.157 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2020-04-28T12:48:51.157 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:51.214 INFO:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Linux" 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8 (Core)" 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8" 2020-04-28T12:48:51.268 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:48:51.269 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:48:51.269 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2020-04-28T12:48:51.269 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:48:51.269 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:48:51.269 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:48:51.270 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:48:51.272 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2020-04-28T12:48:51.286 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:51.301 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-04-28T12:48:51.356 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-04-28T12:48:51.356 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:51.410 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-04-28T12:48:51.463 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Linux" 2020-04-28T12:48:51.464 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8 (Core)" 2020-04-28T12:48:51.464 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2020-04-28T12:48:51.464 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:48:51.464 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2020-04-28T12:48:51.464 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:48:51.465 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:48:51.466 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:48:51.466 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:48:51.466 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:48:51.466 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:48:51.466 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-04-28T12:48:51.481 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-28T12:48:51.498 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-28T12:48:51.535 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-28T12:48:51.535 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:51.554 INFO:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:48:51.596 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:51.609 INFO:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:48:51.664 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-28T12:48:51.677 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-28T12:48:51.677 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:48:51.698 INFO:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:48:51.736 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:51.750 INFO:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:48:51.816 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-28T12:48:51.861 INFO:teuthology.run_tasks:Running task kernel... 2020-04-28T12:48:51.880 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'node-exporter.b': {'sha1': 'distro', 'kdb': True}, 'node-exporter.a': {'sha1': 'distro', 'kdb': True}, 'prometheus.a': {'sha1': 'distro', 'kdb': True}} 2020-04-28T12:48:51.880 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-28T12:48:51.880 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:51.894 INFO:teuthology.orchestra.run.smithi176:> uname -r 2020-04-28T12:48:51.948 INFO:teuthology.orchestra.run.smithi176.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:48:51.948 INFO:teuthology.task.kernel:Running kernel on smithi176: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:48:51.948 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:52.001 INFO:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2020-04-28T12:48:54.555 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - AppStream 40 MB/s | 7.0 MB 00:00 2020-04-28T12:48:55.742 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-04-28T12:48:56.162 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:48:56.298 INFO:teuthology.orchestra.run.smithi176.stdout:Copr repo for ceph-el8 owned by ktdreyer 518 kB/s | 47 kB 00:00 2020-04-28T12:48:56.643 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 22 MB/s | 6.4 MB 00:00 2020-04-28T12:48:58.009 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 4.2 MB/s | 20 kB 00:00 2020-04-28T12:48:58.965 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:48:58.965 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:48:59.116 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:48:59.117 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:48:59.117 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:48:59.269 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:48:59.282 INFO:teuthology.orchestra.run.smithi176:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:48:59.714 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Apr 2020 12:48:58 PM UTC. 2020-04-28T12:49:00.067 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:49:00.068 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.068 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2020-04-28T12:49:00.068 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.068 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalling: 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 1.5 M 2020-04-28T12:49:00.069 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 0 2020-04-28T12:49:00.070 INFO:teuthology.orchestra.run.smithi176.stderr:Operation aborted. 2020-04-28T12:49:00.193 INFO:teuthology.orchestra.run.smithi176.stdout:Is this ok [y/N]: 2020-04-28T12:49:00.194 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:00.207 INFO:teuthology.orchestra.run.smithi176:> sudo yum reinstall -y kernel || true 2020-04-28T12:49:00.635 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:48:58 PM UTC. 2020-04-28T12:49:00.969 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:49:00.969 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalling: 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:00.970 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:49:00.971 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:49:00.971 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:00.971 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 1.5 M 2020-04-28T12:49:00.971 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 0 2020-04-28T12:49:00.971 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:49:01.023 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 30 MB/s | 1.5 MB 00:00 2020-04-28T12:49:01.023 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:49:01.023 INFO:teuthology.orchestra.run.smithi176.stdout:Total 29 MB/s | 1.5 MB 00:00 2020-04-28T12:49:01.069 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:49:01.221 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:49:01.221 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:49:01.266 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:49:01.266 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:49:01.382 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:49:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:49:01.548 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:01.801 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:01.801 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:49:02.165 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:02.165 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:02.165 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalled: 2020-04-28T12:49:02.165 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:02.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:49:02.166 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:49:02.311 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:02.324 INFO:teuthology.orchestra.run.smithi176:> rpm -q kernel --last | head -n 1 2020-04-28T12:49:02.421 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:49:01 PM UTC 2020-04-28T12:49:02.422 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:02.422 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:49:02.422 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:02.441 INFO:teuthology.orchestra.run.smithi084:> uname -r 2020-04-28T12:49:02.498 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:02.498 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:02.498 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:02.553 INFO:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2020-04-28T12:49:05.452 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - AppStream 37 MB/s | 7.0 MB 00:00 2020-04-28T12:49:06.652 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:49:07.083 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:49:07.222 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for ceph-el8 owned by ktdreyer 462 kB/s | 47 kB 00:00 2020-04-28T12:49:07.859 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 11 MB/s | 6.4 MB 00:00 2020-04-28T12:49:09.182 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 3.8 MB/s | 20 kB 00:00 2020-04-28T12:49:10.065 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:49:10.065 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:49:10.207 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:49:10.208 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:49:10.208 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:49:10.351 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:10.364 INFO:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:49:10.796 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Apr 2020 12:49:09 PM UTC. 2020-04-28T12:49:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:11.147 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:49:11.148 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:11.148 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:11.148 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 1.5 M 2020-04-28T12:49:11.148 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2020-04-28T12:49:11.148 INFO:teuthology.orchestra.run.smithi084.stderr:Operation aborted. 2020-04-28T12:49:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:Is this ok [y/N]: 2020-04-28T12:49:11.266 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:11.279 INFO:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2020-04-28T12:49:11.705 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:49:09 PM UTC. 2020-04-28T12:49:12.036 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:49:12.037 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-28T12:49:12.037 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:12.037 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2020-04-28T12:49:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:49:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:12.038 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:49:12.038 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:49:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:12.039 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 1.5 M 2020-04-28T12:49:12.039 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2020-04-28T12:49:12.039 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:49:12.087 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 32 MB/s | 1.5 MB 00:00 2020-04-28T12:49:12.099 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:49:12.099 INFO:teuthology.orchestra.run.smithi084.stdout:Total 31 MB/s | 1.5 MB 00:00 2020-04-28T12:49:12.103 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:49:12.268 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:49:12.268 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:49:12.311 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:49:12.311 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:49:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:49:12.610 INFO:teuthology.orchestra.run.smithi084.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:49:12.611 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:12.836 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:12.836 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalled: 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:49:13.216 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:49:13.360 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:13.373 INFO:teuthology.orchestra.run.smithi084:> rpm -q kernel --last | head -n 1 2020-04-28T12:49:13.483 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:49:12 PM UTC 2020-04-28T12:49:13.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:49:13.484 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:49:13.484 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-28T12:49:13.484 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:13.501 INFO:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:49:13.582 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2020-04-28T12:49:13.594 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-28T12:49:13.595 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:13.608 INFO:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:49:13.699 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2020-04-28T12:49:13.716 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-28T12:49:13.732 INFO:teuthology.task.internal:Creating test directory... 2020-04-28T12:49:13.732 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:13.747 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:49:13.789 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:13.805 INFO:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:49:13.867 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-28T12:49:13.876 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-28T12:49:13.889 INFO:teuthology.task.internal:Creating archive directory... 2020-04-28T12:49:13.890 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:13.903 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:49:13.945 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:13.961 INFO:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:49:14.024 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-28T12:49:14.034 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-28T12:49:14.034 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:14.047 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:49:14.090 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.105 INFO:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:49:14.133 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:49:14.147 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:49:14.191 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:49:14.206 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:49:14.208 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-28T12:49:14.217 INFO:teuthology.task.internal:Configuring sudo... 2020-04-28T12:49:14.217 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:14.231 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:49:14.273 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.288 INFO:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:49:14.358 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-28T12:49:14.372 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-28T12:49:14.374 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:14.387 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:49:14.429 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.443 INFO:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:49:14.498 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.552 INFO:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:49:14.624 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.662 INFO:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:49:14.737 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.791 INFO:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:49:14.863 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:14.900 INFO:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:49:14.967 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:15.021 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:49:15.107 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.120 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:49:15.195 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.232 INFO:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:49:15.308 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.361 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:49:15.435 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.470 INFO:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:49:15.536 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.589 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:49:15.674 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:15.727 INFO:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2020-04-28T12:49:15.769 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:15.783 INFO:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2020-04-28T12:49:15.861 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:49:15.902 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:49:16.126 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-28T12:49:16.145 INFO:teuthology.task.internal:Starting timer... 2020-04-28T12:49:16.145 INFO:teuthology.run_tasks:Running task pcp... 2020-04-28T12:49:16.179 INFO:teuthology.run_tasks:Running task selinux... 2020-04-28T12:49:16.191 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-28T12:49:16.192 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:16.207 INFO:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2020-04-28T12:49:16.336 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: [ OK ] 2020-04-28T12:49:16.338 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:16.353 INFO:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2020-04-28T12:49:16.475 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: [ OK ] 2020-04-28T12:49:16.477 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-28T12:49:16.477 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:16.491 INFO:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2020-04-28T12:49:16.552 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2020-04-28T12:49:16.552 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:16.565 INFO:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2020-04-28T12:49:16.630 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2020-04-28T12:49:16.631 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': u'permissive'} 2020-04-28T12:49:16.631 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:16.644 INFO:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:49:16.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:49:16.712 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:16.726 INFO:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:49:16.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:49:16.794 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-28T12:49:16.794 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:49:16.807 INFO:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:49:16.876 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:49:16.889 INFO:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:49:16.957 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-28T12:49:16.979 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-04-28T12:49:16.988 INFO:teuthology.repo_utils:Fetching master from origin 2020-04-28T12:49:17.039 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-28T12:49:17.059 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-28T12:49:17.062 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi176.front.sepia.ceph.com,smithi084.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-28T12:49:17.441 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-28T12:49:18.678 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-28T12:49:21.621 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-28T12:49:21.643 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:21 +0000 (0:00:00.062) 0:00:00.062 ********* 2020-04-28T12:49:21.654 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:21 +0000 (0:00:00.011) 0:00:00.073 ********* 2020-04-28T12:49:24.110 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi176.front.sepia.ceph.com] 2020-04-28T12:49:24.179 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] 2020-04-28T12:49:24.245 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:24 +0000 (0:00:02.591) 0:00:02.664 ********* 2020-04-28T12:49:24.291 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:24 +0000 (0:00:00.045) 0:00:02.710 ********* 2020-04-28T12:49:24.578 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-28T12:49:24.580 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:49:24.637 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:24 +0000 (0:00:00.346) 0:00:03.056 ********* 2020-04-28T12:49:24.670 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:24 +0000 (0:00:00.032) 0:00:03.089 ********* 2020-04-28T12:49:25.212 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-28T12:49:25.212 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:49:25.251 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.580) 0:00:03.670 ********* 2020-04-28T12:49:25.258 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:49:25.296 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.044) 0:00:03.715 ********* 2020-04-28T12:49:25.303 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-28T12:49:25.304 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:25.342 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.045) 0:00:03.761 ********* 2020-04-28T12:49:25.347 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:25.389 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.047) 0:00:03.808 ********* 2020-04-28T12:49:25.666 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-28T12:49:25.668 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:49:25.707 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.317) 0:00:04.126 ********* 2020-04-28T12:49:25.739 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:25 +0000 (0:00:00.032) 0:00:04.158 ********* 2020-04-28T12:49:26.571 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078165.72-33986375006335/source", "state": "file", "uid": 0} changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078165.76-196627193544384/source", "state": "file", "uid": 0} 2020-04-28T12:49:26.626 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:26 +0000 (0:00:00.886) 0:00:05.045 ********* 2020-04-28T12:49:26.666 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:26 +0000 (0:00:00.039) 0:00:05.085 ********* 2020-04-28T12:49:27.370 INFO:teuthology.task.ansible.out: 2020-04-28T12:49:27.370 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-28T12:49:27.372 INFO:teuthology.task.ansible.out: ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiE 2020-04-28T12:49:27.373 INFO:teuthology.task.ansible.out:lv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:49:27.375 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:49:27.376 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:49:27.560 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-28T12:49:27.566 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-28T12:49:27.756 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:27 +0000 (0:00:01.089) 0:00:06.175 ********* 2020-04-28T12:49:27.789 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:27 +0000 (0:00:00.033) 0:00:06.208 ********* 2020-04-28T12:49:28.411 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi084.front.sepia.ceph.com] 2020-04-28T12:49:28.497 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Tuesday 28 April 2020 12:49:28 +0000 (0:00:00.707) 0:00:06.916 ********* 2020-04-28T12:49:29.087 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.183901", "end": "2020-04-28 12:49:29.067523", "rc": 0, "start": "2020-04-28 12:49:28.883622", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:49:29.133 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.636) 0:00:07.552 ********* 2020-04-28T12:49:29.337 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-28T12:49:29.338 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011874", "end": "2020-04-28 12:49:29.316211", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:49:29.304337", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:49:29.375 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.241) 0:00:07.793 ********* 2020-04-28T12:49:29.401 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-28T12:49:29.403 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:49:29.437 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.062) 0:00:07.856 ********* 2020-04-28T12:49:29.456 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-28T12:49:29.458 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] 2020-04-28T12:49:29.464 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.501 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.064) 0:00:07.920 ********* 2020-04-28T12:49:29.542 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:49:29.543 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.579 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.078) 0:00:07.998 ********* 2020-04-28T12:49:29.626 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.046) 0:00:08.045 ********* 2020-04-28T12:49:29.631 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-28T12:49:29.631 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.675 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.048) 0:00:08.093 ********* 2020-04-28T12:49:29.701 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-28T12:49:29.703 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.758 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.083) 0:00:08.177 ********* 2020-04-28T12:49:29.784 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:49:29.786 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.821 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.062) 0:00:08.239 ********* 2020-04-28T12:49:29.868 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:29.870 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.880 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.880 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.891 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.892 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.904 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.905 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.926 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.927 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.928 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.930 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi176.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.168753", "end": "2020-04-28 12:49:29.904854", "rc": 0, "start": "2020-04-28 12:49:29.736101", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:49:29.930 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.991 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:29 +0000 (0:00:00.166) 0:00:08.406 ********* 2020-04-28T12:49:29.993 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.996 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.997 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.999 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:29.999 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.000 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.001 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.002 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.003 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.005 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.016 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.016 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.029 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.038 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.039 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.040 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.051 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.061 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.062 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.073 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.074 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.085 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.085 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.100 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.108 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.109 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.121 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.124 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.134 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.145 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.145 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.157 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.158 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.159 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.170 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.171 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.182 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.182 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.193 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.194 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.205 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.206 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-28T12:49:30.207 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014103", "end": "2020-04-28 12:49:30.178514", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:49:30.164411", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.208 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.262 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.274) 0:00:08.681 ********* 2020-04-28T12:49:30.268 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.269 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.271 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.272 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.273 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.274 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.275 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.276 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.278 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.289 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-28T12:49:30.290 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:49:30.339 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.077) 0:00:08.758 ********* 2020-04-28T12:49:30.355 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansib 2020-04-28T12:49:30.357 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was Fals 2020-04-28T12:49:30.358 INFO:teuthology.task.ansible.out:e"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.367 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.368 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-28T12:49:30.368 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.370 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.371 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.412 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.073) 0:00:08.831 ********* 2020-04-28T12:49:30.418 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.419 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.420 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.420 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.422 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.443 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:49:30.444 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.483 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.070) 0:00:08.902 ********* 2020-04-28T12:49:30.509 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-28T12:49:30.510 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.554 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.071) 0:00:08.973 ********* 2020-04-28T12:49:30.560 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:30.561 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.562 INFO:teuthology.task.ansible.out: 2020-04-28T12:49:30.564 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.576 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.579 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.580 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.581 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.065) 0:00:09.038 ********* 2020-04-28T12:49:30.627 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.628 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.630 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.631 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.633 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.634 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.635 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.637 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.647 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:49:30.648 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.651 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.652 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.700 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.080) 0:00:09.119 ********* 2020-04-28T12:49:30.706 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.707 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.709 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.709 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.710 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.712 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.078) 0:00:09.197 ********* 2020-04-28T12:49:30.785 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.787 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.789 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.790 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b 2020-04-28T12:49:30.792 INFO:teuthology.task.ansible.out:87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.793 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.805 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:49:30.805 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:30.805 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.807 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.850 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.071) 0:00:09.269 ********* 2020-04-28T12:49:30.859 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.861 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.862 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.864 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.865 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.865 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.867 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.878 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.878 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:49:30.878 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.880 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.923 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:30 +0000 (0:00:00.072) 0:00:09.342 ********* 2020-04-28T12:49:30.932 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.934 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.942 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "it 2020-04-28T12:49:30.943 INFO:teuthology.task.ansible.out:em", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.945 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.954 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.954 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:30.956 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.083) 0:00:09.425 ********* 2020-04-28T12:49:31.016 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.018 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.019 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.021 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.022 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.022 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.024 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.025 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.027 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.028 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.029 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.043 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.044 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.046 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.046 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.052 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.114 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.108) 0:00:09.533 ********* 2020-04-28T12:49:31.121 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.122 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.123 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.124 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.126 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.126 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.127 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.138 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-28T12:49:31.140 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.174 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.059) 0:00:09.593 ********* 2020-04-28T12:49:31.200 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-28T12:49:31.202 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.242 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.067) 0:00:09.661 ********* 2020-04-28T12:49:31.248 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.249 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.250 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.252 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.252 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.253 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.265 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.265 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.276 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.278 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.279 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.290 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.291 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.291 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.292 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.303 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.304 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.305 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.316 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.317 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.328 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.329 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.329 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.330 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.331 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.331 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.331 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.332 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.345 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.347 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.348 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.360 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.361 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.361 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.362 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.363 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.374 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.378 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.387 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.388 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.390 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.390 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.390 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.401 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.403 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.413 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.415 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.416 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.426 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.428 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.428 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.428 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.439 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.441 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.441 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.452 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.454 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.454 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.466 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.467 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.468 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.479 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.480 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.480 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.481 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.492 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.493 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.494 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.494 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.505 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.507 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.507 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.518 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.519 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.520 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.521 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.532 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:49:31.533 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.533 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.534 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.535 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.545 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.547 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.548 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:31.548 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.553 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi176.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.606 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.363) 0:00:10.025 ********* 2020-04-28T12:49:31.640 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.034) 0:00:10.059 ********* 2020-04-28T12:49:31.666 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:49:31.705 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.064) 0:00:10.124 ********* 2020-04-28T12:49:31.731 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:49:31.733 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.774 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.066) 0:00:10.190 ********* 2020-04-28T12:49:31.798 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:49:31.799 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.835 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.063) 0:00:10.254 ********* 2020-04-28T12:49:31.861 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-28T12:49:31.863 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.899 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.064) 0:00:10.318 ********* 2020-04-28T12:49:31.936 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-28T12:49:31.938 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:31.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:31 +0000 (0:00:00.074) 0:00:10.393 ********* 2020-04-28T12:49:32.000 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-28T12:49:32.002 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.039 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.065) 0:00:10.458 ********* 2020-04-28T12:49:32.076 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:32.078 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.088 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.088 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.099 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.100 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.111 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.111 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.113 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.123 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.124 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.135 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.136 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.146 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.157 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.158 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.160 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.169 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.170 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.181 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.182 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.183 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.195 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.206 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.224 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.235 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.247 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.248 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.259 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.375 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-28T12:49:32.376 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:49:32.434 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.394) 0:00:10.853 ********* 2020-04-28T12:49:32.443 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:49:32.444 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.446 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.447 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.448 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.450 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.451 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.494 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.059) 0:00:10.913 ********* 2020-04-28T12:49:32.500 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-28T12:49:32.501 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => { "msg": "Host smithi084.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:49:32.540 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.046) 0:00:10.959 ********* 2020-04-28T12:49:32.595 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-28T12:49:32.597 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:49:32.644 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.104) 0:00:11.063 ********* 2020-04-28T12:49:32.671 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:49:32.671 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:32.718 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:32 +0000 (0:00:00.073) 0:00:11.137 ********* 2020-04-28T12:49:32.977 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-28T12:49:32.977 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:49:33.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.305) 0:00:11.442 ********* 2020-04-28T12:49:33.029 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:49:33.030 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.085524", "end": "2020-04-28 12:49:32.980710", "rc": 0, "start": "2020-04-28 12:49:32.895186", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:49:33.067 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.043) 0:00:11.486 ********* 2020-04-28T12:49:33.072 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-28T12:49:33.074 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => { "msg": "Host smithi176.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:49:33.116 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.048) 0:00:11.535 ********* 2020-04-28T12:49:33.122 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-28T12:49:33.123 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.163 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.047) 0:00:11.582 ********* 2020-04-28T12:49:33.170 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-28T12:49:33.170 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:49:33.214 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.050) 0:00:11.633 ********* 2020-04-28T12:49:33.220 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:49:33.221 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.258 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.043) 0:00:11.677 ********* 2020-04-28T12:49:33.264 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:49:33.264 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.303 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.044) 0:00:11.721 ********* 2020-04-28T12:49:33.310 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:49:33.312 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.347 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.044) 0:00:11.766 ********* 2020-04-28T12:49:33.385 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:49:33.386 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.423 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.076) 0:00:11.842 ********* 2020-04-28T12:49:33.460 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-28T12:49:33.461 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.498 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.074) 0:00:11.917 ********* 2020-04-28T12:49:33.535 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:49:33.536 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.572 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.074) 0:00:11.991 ********* 2020-04-28T12:49:33.589 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:49:33.589 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.080874", "end": "2020-04-28 12:49:33.553255", "rc": 0, "start": "2020-04-28 12:49:33.472381", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:49:33.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.058) 0:00:12.050 ********* 2020-04-28T12:49:33.642 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi084.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:33.676 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.045) 0:00:12.095 ********* 2020-04-28T12:49:33.684 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-28T12:49:33.684 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.728 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.051) 0:00:12.147 ********* 2020-04-28T12:49:33.735 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-28T12:49:33.737 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.049) 0:00:12.197 ********* 2020-04-28T12:49:33.784 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:49:33.784 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.046) 0:00:12.243 ********* 2020-04-28T12:49:33.829 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:49:33.831 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.875 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.050) 0:00:12.294 ********* 2020-04-28T12:49:33.881 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:49:33.881 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:33.918 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.042) 0:00:12.337 ********* 2020-04-28T12:49:33.923 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:49:33.923 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:33.960 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:33 +0000 (0:00:00.041) 0:00:12.379 ********* 2020-04-28T12:49:33.966 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:49:33.968 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.004 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.044) 0:00:12.423 ********* 2020-04-28T12:49:34.010 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-28T12:49:34.011 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.054 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.049) 0:00:12.473 ********* 2020-04-28T12:49:34.060 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-28T12:49:34.061 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.099 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.045) 0:00:12.518 ********* 2020-04-28T12:49:34.104 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:49:34.106 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:34.141 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.042) 0:00:12.560 ********* 2020-04-28T12:49:34.147 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:49:34.148 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.184 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.042) 0:00:12.603 ********* 2020-04-28T12:49:34.196 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-28T12:49:34.197 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.232 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.047) 0:00:12.651 ********* 2020-04-28T12:49:34.259 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:49:34.260 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.297 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.064) 0:00:12.716 ********* 2020-04-28T12:49:34.355 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-28T12:49:34.357 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:34.507 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.210) 0:00:12.926 ********* 2020-04-28T12:49:34.513 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:49:34.514 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.554 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.047) 0:00:12.973 ********* 2020-04-28T12:49:34.560 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-28T12:49:34.561 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.600 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.046) 0:00:13.019 ********* 2020-04-28T12:49:34.606 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-28T12:49:34.607 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.647 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.046) 0:00:13.066 ********* 2020-04-28T12:49:34.653 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:49:34.654 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.691 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.043) 0:00:13.110 ********* 2020-04-28T12:49:34.696 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-28T12:49:34.697 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:34.734 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.042) 0:00:13.153 ********* 2020-04-28T12:49:34.738 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:49:34.740 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:34.776 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.041) 0:00:13.195 ********* 2020-04-28T12:49:34.781 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:49:34.783 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.822 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.045) 0:00:13.240 ********* 2020-04-28T12:49:34.827 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-28T12:49:34.828 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.866 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.044) 0:00:13.285 ********* 2020-04-28T12:49:34.871 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-28T12:49:34.872 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.909 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.043) 0:00:13.328 ********* 2020-04-28T12:49:34.914 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:49:34.915 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:34.952 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.042) 0:00:13.371 ********* 2020-04-28T12:49:34.956 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-28T12:49:34.956 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:34.993 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:34 +0000 (0:00:00.041) 0:00:13.412 ********* 2020-04-28T12:49:35.001 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-28T12:49:35.002 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.037 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.043) 0:00:13.456 ********* 2020-04-28T12:49:35.042 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-28T12:49:35.050 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.083 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.045) 0:00:13.502 ********* 2020-04-28T12:49:35.088 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:49:35.088 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.126 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.043) 0:00:13.545 ********* 2020-04-28T12:49:35.130 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-28T12:49:35.131 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.170 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.043) 0:00:13.589 ********* 2020-04-28T12:49:35.176 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:49:35.178 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.214 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.043) 0:00:13.633 ********* 2020-04-28T12:49:35.221 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-28T12:49:35.223 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.274 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.059) 0:00:13.693 ********* 2020-04-28T12:49:35.291 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.329 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.055) 0:00:13.748 ********* 2020-04-28T12:49:35.334 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-28T12:49:35.335 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:35.382 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.049) 0:00:13.797 ********* 2020-04-28T12:49:35.384 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-28T12:49:35.385 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:35.422 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.044) 0:00:13.841 ********* 2020-04-28T12:49:35.428 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:49:35.469 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.046) 0:00:13.887 ********* 2020-04-28T12:49:35.475 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:49:35.477 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.515 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.046) 0:00:13.934 ********* 2020-04-28T12:49:35.526 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.561 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.045) 0:00:13.980 ********* 2020-04-28T12:49:35.567 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-28T12:49:35.568 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.606 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.044) 0:00:14.025 ********* 2020-04-28T12:49:35.632 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.678 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.070) 0:00:14.095 ********* 2020-04-28T12:49:35.703 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-28T12:49:35.705 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.746 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.069) 0:00:14.165 ********* 2020-04-28T12:49:35.785 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-28T12:49:35.786 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:49:35.786 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.827 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.081) 0:00:14.246 ********* 2020-04-28T12:49:35.870 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.042) 0:00:14.289 ********* 2020-04-28T12:49:35.898 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-28T12:49:35.900 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:35.945 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:35 +0000 (0:00:00.074) 0:00:14.363 ********* 2020-04-28T12:49:35.972 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-28T12:49:35.974 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:49:36.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:36 +0000 (0:00:00.077) 0:00:14.441 ********* 2020-04-28T12:49:36.049 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:49:36.087 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:36 +0000 (0:00:00.065) 0:00:14.506 ********* 2020-04-28T12:49:36.114 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-28T12:49:36.115 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:36.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:36 +0000 (0:00:00.065) 0:00:14.572 ********* 2020-04-28T12:49:36.360 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-28T12:49:36.361 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:49:36.362 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-28T12:49:36.364 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:49:36.405 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:36 +0000 (0:00:00.252) 0:00:14.824 ********* 2020-04-28T12:49:36.841 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-28T12:49:36.842 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:49:36.884 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:36 +0000 (0:00:00.478) 0:00:15.302 ********* 2020-04-28T12:49:36.900 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:49:37.358 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:49:37.402 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:37 +0000 (0:00:00.518) 0:00:15.821 ********* 2020-04-28T12:49:37.408 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-28T12:49:37.410 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:49:37.835 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:49:37.875 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:37 +0000 (0:00:00.473) 0:00:16.294 ********* 2020-04-28T12:49:37.914 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:49:37.917 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:37.953 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:37 +0000 (0:00:00.077) 0:00:16.372 ********* 2020-04-28T12:49:37.988 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:49:37.990 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.031 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.078) 0:00:16.450 ********* 2020-04-28T12:49:38.059 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-28T12:49:38.060 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.105 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.069) 0:00:16.519 ********* 2020-04-28T12:49:38.128 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:49:38.129 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.178 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.077) 0:00:16.597 ********* 2020-04-28T12:49:38.204 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:49:38.206 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.248 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.069) 0:00:16.667 ********* 2020-04-28T12:49:38.275 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:49:38.277 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.066) 0:00:16.733 ********* 2020-04-28T12:49:38.341 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:49:38.343 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.392 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.077) 0:00:16.810 ********* 2020-04-28T12:49:38.398 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-28T12:49:38.399 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:49:38.452 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.059) 0:00:16.870 ********* 2020-04-28T12:49:38.460 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:49:38.461 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.510 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.053) 0:00:16.924 ********* TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:49:38.512 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.563 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.057) 0:00:16.982 ********* 2020-04-28T12:49:38.569 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:49:38.571 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.609 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.045) 0:00:17.028 ********* 2020-04-28T12:49:38.616 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:49:38.617 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.667 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.058) 0:00:17.086 ********* 2020-04-28T12:49:38.698 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.750 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.082) 0:00:17.169 ********* 2020-04-28T12:49:38.777 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:49:38.778 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.815 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.064) 0:00:17.234 ********* 2020-04-28T12:49:38.841 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:49:38.842 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.880 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.065) 0:00:17.299 ********* 2020-04-28T12:49:38.906 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:49:38.907 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:38.944 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:38 +0000 (0:00:00.064) 0:00:17.363 ********* 2020-04-28T12:49:38.981 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:49:38.981 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:39.025 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:39 +0000 (0:00:00.081) 0:00:17.444 ********* 2020-04-28T12:49:39.054 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:39.094 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:39 +0000 (0:00:00.066) 0:00:17.510 ********* 2020-04-28T12:49:39.117 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:49:39.119 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:39.156 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:39 +0000 (0:00:00.064) 0:00:17.575 ********* 2020-04-28T12:49:39.524 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-28T12:49:39.525 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.716228", "end": "2020-04-28 12:49:39.500331", "rc": 0, "start": "2020-04-28 12:49:38.784103", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.168810", "end": "2020-04-28 12:49:39.500309", "rc": 0, "start": "2020-04-28 12:49:39.331499", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:49:39.563 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:39 +0000 (0:00:00.407) 0:00:17.982 ********* 2020-04-28T12:49:39.596 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:39 +0000 (0:00:00.033) 0:00:18.015 ********* 2020-04-28T12:49:40.661 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-28T12:49:40.663 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:49:40.703 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:01.106) 0:00:19.122 ********* 2020-04-28T12:49:40.709 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:49:40.751 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.045) 0:00:19.168 ********* 2020-04-28T12:49:40.755 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-28T12:49:40.755 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:40.798 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.048) 0:00:19.217 ********* 2020-04-28T12:49:40.806 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:40.844 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.046) 0:00:19.263 ********* 2020-04-28T12:49:40.850 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-28T12:49:40.851 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:40.890 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.045) 0:00:19.309 ********* 2020-04-28T12:49:40.896 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:40.936 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.046) 0:00:19.355 ********* 2020-04-28T12:49:40.942 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-28T12:49:40.944 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:40.982 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:40 +0000 (0:00:00.046) 0:00:19.401 ********* 2020-04-28T12:49:40.988 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:41.028 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:41 +0000 (0:00:00.045) 0:00:19.447 ********* 2020-04-28T12:49:41.035 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-28T12:49:41.037 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:41.075 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:41 +0000 (0:00:00.047) 0:00:19.494 ********* 2020-04-28T12:49:41.081 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:41.126 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:41 +0000 (0:00:00.047) 0:00:19.541 ********* 2020-04-28T12:49:41.536 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-28T12:49:41.536 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:49:41.576 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:41 +0000 (0:00:00.453) 0:00:19.995 ********* 2020-04-28T12:49:41.594 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:49:41.638 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:41 +0000 (0:00:00.061) 0:00:20.056 ********* 2020-04-28T12:49:42.484 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-28T12:49:42.484 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:49:42.524 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:42 +0000 (0:00:00.886) 0:00:20.943 ********* 2020-04-28T12:49:42.551 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:49:42.589 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:42 +0000 (0:00:00.065) 0:00:21.008 ********* 2020-04-28T12:49:43.024 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi084.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:49:43.100 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:49:43.497 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:49:43.560 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:49:43.949 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:49:44.008 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:44 +0000 (0:00:01.418) 0:00:22.427 ********* 2020-04-28T12:49:44.040 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:49:44.079 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:44 +0000 (0:00:00.071) 0:00:22.498 ********* 2020-04-28T12:49:44.221 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-28T12:49:44.223 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:49:44.259 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:44 +0000 (0:00:00.179) 0:00:22.678 ********* 2020-04-28T12:49:44.276 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:49:44.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:44 +0000 (0:00:00.055) 0:00:22.733 ********* 2020-04-28T12:49:44.729 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:49:44.730 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:49:44.774 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:49:45.169 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:49:45.203 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:49:45.600 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:49:45.661 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:01.346) 0:00:24.079 ********* 2020-04-28T12:49:45.668 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:49:45.710 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:00.049) 0:00:24.129 ********* 2020-04-28T12:49:45.716 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:49:45.717 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:45.755 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:00.045) 0:00:24.174 ********* 2020-04-28T12:49:45.762 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:45.803 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:00.047) 0:00:24.222 ********* 2020-04-28T12:49:45.809 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:49:45.810 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:49:45.849 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:00.046) 0:00:24.268 ********* 2020-04-28T12:49:45.856 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:49:45.895 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:45 +0000 (0:00:00.045) 0:00:24.314 ********* 2020-04-28T12:49:46.068 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-28T12:49:46.069 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:49:46.106 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:46 +0000 (0:00:00.210) 0:00:24.525 ********* 2020-04-28T12:49:46.125 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:49:46.166 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:46 +0000 (0:00:00.059) 0:00:24.585 ********* 2020-04-28T12:49:46.172 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:49:46.173 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.175 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.177 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.178 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.220 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:46 +0000 (0:00:00.054) 0:00:24.639 ********* 2020-04-28T12:49:46.228 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.229 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.231 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.242 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:46.284 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:46 +0000 (0:00:00.064) 0:00:24.703 ********* 2020-04-28T12:49:47.137 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:49:47.141 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:49:47.176 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.892) 0:00:25.595 ********* 2020-04-28T12:49:47.204 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:49:47.206 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-28T12:49:47.207 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:47.243 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.066) 0:00:25.661 ********* 2020-04-28T12:49:47.276 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.033) 0:00:25.695 ********* 2020-04-28T12:49:47.314 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:47.351 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.074) 0:00:25.770 ********* 2020-04-28T12:49:47.716 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:49:47.764 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.413) 0:00:26.183 ********* 2020-04-28T12:49:47.831 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:49:47.870 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:47 +0000 (0:00:00.105) 0:00:26.289 ********* 2020-04-28T12:49:48.257 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:49:48.259 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:49:48.300 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.430) 0:00:26.719 ********* 2020-04-28T12:49:48.337 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:49:48.338 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:48.350 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:49:48.350 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:49:48.400 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.099) 0:00:26.819 ********* 2020-04-28T12:49:48.406 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:49:48.406 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:48.451 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.051) 0:00:26.870 ********* 2020-04-28T12:49:48.458 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:48.459 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:49:48.499 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.047) 0:00:26.918 ********* 2020-04-28T12:49:48.650 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:49:48.651 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:49:48.688 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.189) 0:00:27.107 ********* 2020-04-28T12:49:48.715 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:49:48.754 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.065) 0:00:27.173 ********* 2020-04-28T12:49:48.927 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:49:48.928 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:49:48.929 INFO:teuthology.task.ansible.out:...ignoring 2020-04-28T12:49:48.965 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:48 +0000 (0:00:00.211) 0:00:27.384 ********* 2020-04-28T12:49:48.993 INFO:teuthology.task.ansible.out:fatal: [smithi176.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:49:48.994 INFO:teuthology.task.ansible.out:...ignoring TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:49.032 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:49 +0000 (0:00:00.066) 0:00:27.451 ********* 2020-04-28T12:49:49.071 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:49 +0000 (0:00:00.039) 0:00:27.490 ********* 2020-04-28T12:49:49.099 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:49:49.142 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:49 +0000 (0:00:00.070) 0:00:27.561 ********* 2020-04-28T12:49:49.503 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:49:49.540 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:49 +0000 (0:00:00.398) 0:00:27.959 ********* 2020-04-28T12:49:49.610 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:49:49.647 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:49 +0000 (0:00:00.106) 0:00:28.066 ********* 2020-04-28T12:49:50.250 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-28T12:49:50.252 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:48:42 UTC", "ActiveEnterTimestampMonotonic": "14969665", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target sysinit.target var-run.mount systemd-tmpfiles-setup.service system.slice tmp.mount -.mount network.target nss-lookup.target local-fs.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:48:42 UTC", "AssertTimestampMonotonic": "14968890", "Before": "getty@tty1.service shutdown.target multi-user.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:48:42 UTC", "ConditionTimestampMonotonic": "14968890", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:49:50.254 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2503", "ExecMainStartTimestamp": "Tue 2020-04-28 12:48:42 UTC", "ExecMainStartTimestampMonotonic": "14969631", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:48:42 UTC] ; stop_time=[n/a] ; pid=2503 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:48:42 UTC", "InactiveExitTimestampMonotonic": "14969665", "InvocationID": "b4111bbeae12425b85c12f8fc6d29dd4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:49:50.255 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2503", "MemoryAccounting": "yes", "MemoryCurrent": "1110016", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:49:50.257 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:48:42 UTC", "StateChangeTimestampMonotonic": "14969665", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:48:42 UTC", "WatchdogTimestampMonotonic": "14969664", "WatchdogUSec": "0"}} 2020-04-28T12:49:50.292 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:50 +0000 (0:00:00.644) 0:00:28.711 ********* 2020-04-28T12:49:50.301 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:48:03 UTC", "ActiveEnterTimestampMonotonic": "14469394", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target time-sync.target var-run.mount -.mount local-fs.target systemd-journald.socket tmp.mount basic.target systemd-tmpfiles-setup.service system.slice sysinit.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:48:03 UTC", "AssertTimestampMonotonic": "14468509", "Before": "getty@tty1.service shutdown.target plymouth-quit.service multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:48:03 UTC", "ConditionTimestampMonotonic": "14468509", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:49:50.303 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2508", "ExecMainStartTimestamp": "Tue 2020-04-28 12:48:03 UTC", "ExecMainStartTimestampMonotonic": "14469364", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:48:03 UTC] ; stop_time=[n/a] ; pid=2508 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:48:03 UTC", "InactiveExitTimestampMonotonic": "14469394", "InvocationID": "7bd33023d05540fcacdd748307a23148", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:49:50.304 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2508", "MemoryAccounting": "yes", "MemoryCurrent": "1089536", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:49:50.306 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:48:03 UTC", "StateChangeTimestampMonotonic": "14469394", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:48:03 UTC", "WatchdogTimestampMonotonic": "14469394", "WatchdogUSec": "0"}} 2020-04-28T12:49:50.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:50 +0000 (0:00:00.053) 0:00:28.764 ********* 2020-04-28T12:49:50.496 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-28T12:49:50.497 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001682", "end": "2020-04-28 12:49:50.461933", "rc": 0, "start": "2020-04-28 12:49:50.460251", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:49:50.533 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:50 +0000 (0:00:00.187) 0:00:28.952 ********* 2020-04-28T12:49:50.550 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001634", "end": "2020-04-28 12:49:50.518778", "rc": 0, "start": "2020-04-28 12:49:50.517144", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:49:50.592 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:50 +0000 (0:00:00.059) 0:00:29.011 ********* 2020-04-28T12:49:51.446 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-28T12:49:51.446 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:49:51.486 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:51 +0000 (0:00:00.893) 0:00:29.905 ********* 2020-04-28T12:49:51.513 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:49:51.553 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:51 +0000 (0:00:00.066) 0:00:29.972 ********* 2020-04-28T12:49:52.402 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-28T12:49:52.403 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:49:52.439 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:52 +0000 (0:00:00.886) 0:00:30.858 ********* 2020-04-28T12:49:52.466 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:49:52.504 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:52 +0000 (0:00:00.065) 0:00:30.923 ********* 2020-04-28T12:49:53.756 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-28T12:49:53.758 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:49:53.794 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:53 +0000 (0:00:01.289) 0:00:32.213 ********* 2020-04-28T12:49:53.800 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:49:53.838 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:49:53 +0000 (0:00:00.044) 0:00:32.257 ********* 2020-04-28T12:50:10.228 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:50:10.230 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.231378", "end": "2020-04-28 12:50:10.196332", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:49:53.964954", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:50:10.268 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:10 +0000 (0:00:16.429) 0:00:48.687 ********* 2020-04-28T12:50:10.327 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.282781", "end": "2020-04-28 12:50:10.291722", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:49:54.008941", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:50:10.369 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:10 +0000 (0:00:00.101) 0:00:48.788 ********* 2020-04-28T12:50:10.745 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:50:10.745 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:50:10.784 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:10 +0000 (0:00:00.415) 0:00:49.203 ********* 2020-04-28T12:50:10.864 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:50:10.904 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:10 +0000 (0:00:00.119) 0:00:49.323 ********* 2020-04-28T12:50:10.993 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:50:10.993 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015326", "end": "2020-04-28 12:50:10.972378", "rc": 0, "start": "2020-04-28 12:50:10.957052", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:11.042 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:11 +0000 (0:00:00.138) 0:00:49.461 ********* 2020-04-28T12:50:11.122 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016091", "end": "2020-04-28 12:50:11.096326", "rc": 0, "start": "2020-04-28 12:50:11.080235", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:11.161 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:11 +0000 (0:00:00.118) 0:00:49.580 ********* 2020-04-28T12:50:11.260 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:50:11.260 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002739", "end": "2020-04-28 12:50:11.216039", "rc": 0, "start": "2020-04-28 12:50:11.213300", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:11.298 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:11 +0000 (0:00:00.137) 0:00:49.717 ********* 2020-04-28T12:50:11.376 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002239", "end": "2020-04-28 12:50:11.332563", "rc": 0, "start": "2020-04-28 12:50:11.330324", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:11.415 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:11 +0000 (0:00:00.116) 0:00:49.834 ********* 2020-04-28T12:50:27.647 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:50:27.648 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.152248", "end": "2020-04-28 12:50:27.622493", "rc": 0, "start": "2020-04-28 12:50:11.470245", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:27.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:27 +0000 (0:00:16.272) 0:01:06.106 ********* 2020-04-28T12:50:27.769 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.163856", "end": "2020-04-28 12:50:27.746923", "rc": 0, "start": "2020-04-28 12:50:11.583067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:27.807 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:27 +0000 (0:00:00.119) 0:01:06.226 ********* 2020-04-28T12:50:27.896 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:50:27.897 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:50:27.935 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:27 +0000 (0:00:00.128) 0:01:06.354 ********* 2020-04-28T12:50:27.962 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:50:27.963 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:50:28.000 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:27 +0000 (0:00:00.065) 0:01:06.419 ********* 2020-04-28T12:50:28.017 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:50:28.018 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:50:28.058 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.057) 0:01:06.477 ********* 2020-04-28T12:50:28.064 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:50:28.064 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:50:28.105 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.047) 0:01:06.524 ********* 2020-04-28T12:50:28.115 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:50:28.157 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.051) 0:01:06.576 ********* 2020-04-28T12:50:28.163 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:50:28.164 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:50:28.205 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.048) 0:01:06.624 ********* 2020-04-28T12:50:28.211 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:50:28.211 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:50:28.252 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.047) 0:01:06.671 ********* 2020-04-28T12:50:28.258 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:50:28.258 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:50:28.300 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.047) 0:01:06.719 ********* 2020-04-28T12:50:28.306 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:50:28.307 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:50:28.349 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.048) 0:01:06.768 ********* 2020-04-28T12:50:28.398 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:50:28.399 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:50:28.436 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.087) 0:01:06.855 ********* 2020-04-28T12:50:28.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:50:28.508 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:50:28.544 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.107) 0:01:06.963 ********* 2020-04-28T12:50:28.640 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:50:28.679 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.134) 0:01:07.097 ********* 2020-04-28T12:50:28.748 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:50:28.749 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:50:28.789 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.110) 0:01:07.208 ********* 2020-04-28T12:50:28.837 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:50:28.839 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:28.889 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.099) 0:01:07.307 ********* 2020-04-28T12:50:28.897 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:50:28.898 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:50:28.946 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:28 +0000 (0:00:00.056) 0:01:07.364 ********* 2020-04-28T12:50:28.953 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-28T12:50:28.954 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:29.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.061) 0:01:07.425 ********* 2020-04-28T12:50:29.014 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:50:29.016 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:29.073 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.061) 0:01:07.487 ********* 2020-04-28T12:50:29.099 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:29.155 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.086) 0:01:07.574 ********* 2020-04-28T12:50:29.231 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:50:29.279 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.124) 0:01:07.698 ********* 2020-04-28T12:50:29.391 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:50:29.434 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.155) 0:01:07.853 ********* 2020-04-28T12:50:29.857 INFO:teuthology.task.ansible.out: 2020-04-28T12:50:29.859 INFO:teuthology.task.ansible.out:TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:50:29.896 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.461) 0:01:08.315 ********* 2020-04-28T12:50:29.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:50:29.942 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi084"}, "changed": false} 2020-04-28T12:50:29.979 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:29 +0000 (0:00:00.082) 0:01:08.397 ********* 2020-04-28T12:50:30.028 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:50:30.029 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:50:30.067 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:30 +0000 (0:00:00.087) 0:01:08.485 ********* 2020-04-28T12:50:30.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:50:30.105 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi176"}, "changed": false} 2020-04-28T12:50:30.143 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:30 +0000 (0:00:00.076) 0:01:08.562 ********* 2020-04-28T12:50:31.086 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:50:31.087 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi084.front.sepia.ceph.com", "ansible_hostname": "smithi084", "ansible_nodename": "smithi084"}, "changed": true, "name": "smithi084"} 2020-04-28T12:50:31.129 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:31 +0000 (0:00:00.986) 0:01:09.548 ********* 2020-04-28T12:50:31.136 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi176", "ansible_hostname": "smithi176", "ansible_nodename": "smithi176"}, "changed": false, "name": "smithi176"} 2020-04-28T12:50:31.177 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:31 +0000 (0:00:00.047) 0:01:09.596 ********* 2020-04-28T12:50:31.601 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:50:31.601 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:50:31.641 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:31 +0000 (0:00:00.463) 0:01:10.060 ********* 2020-04-28T12:50:31.647 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:50:31.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:31 +0000 (0:00:00.045) 0:01:10.106 ********* 2020-04-28T12:50:31.688 INFO:teuthology.task.ansible.out: 2020-04-28T12:50:32.103 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:50:32.104 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:50:32.142 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:32 +0000 (0:00:00.455) 0:01:10.561 ********* 2020-04-28T12:50:32.150 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:50:32.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:32 +0000 (0:00:00.069) 0:01:10.630 ********* 2020-04-28T12:50:32.783 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:50:32.785 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:50:32.820 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:32 +0000 (0:00:00.609) 0:01:11.239 ********* 2020-04-28T12:50:32.858 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:50:32.897 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:32 +0000 (0:00:00.076) 0:01:11.316 ********* 2020-04-28T12:50:33.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:50:33.294 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:50:33.339 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.441) 0:01:11.758 ********* 2020-04-28T12:50:33.395 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:50:33.434 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.094) 0:01:11.852 ********* 2020-04-28T12:50:33.544 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:50:33.544 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:50:33.585 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.151) 0:01:12.004 ********* 2020-04-28T12:50:33.633 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:50:33.673 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.088) 0:01:12.092 ********* 2020-04-28T12:50:33.796 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:50:33.798 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:50:33.835 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.162) 0:01:12.254 ********* 2020-04-28T12:50:33.883 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:50:33.928 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:33 +0000 (0:00:00.093) 0:01:12.347 ********* 2020-04-28T12:50:34.059 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:50:34.059 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:50:34.100 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:34 +0000 (0:00:00.171) 0:01:12.519 ********* 2020-04-28T12:50:34.148 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:50:34.191 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:34 +0000 (0:00:00.090) 0:01:12.610 ********* 2020-04-28T12:50:34.598 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:50:34.599 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:50:34.638 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:34 +0000 (0:00:00.447) 0:01:13.057 ********* 2020-04-28T12:50:34.666 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:50:34.706 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:34 +0000 (0:00:00.067) 0:01:13.125 ********* 2020-04-28T12:50:35.136 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:50:35.136 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:50:35.175 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:35 +0000 (0:00:00.469) 0:01:13.594 ********* 2020-04-28T12:50:35.212 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:50:35.254 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:35 +0000 (0:00:00.079) 0:01:13.673 ********* 2020-04-28T12:50:37.008 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:50:37.009 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.639655", "end": "2020-04-28 12:50:36.981976", "rc": 0, "start": "2020-04-28 12:50:35.342321", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:37.046 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:37 +0000 (0:00:01.791) 0:01:15.465 ********* 2020-04-28T12:50:37.118 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.663180", "end": "2020-04-28 12:50:37.087956", "rc": 0, "start": "2020-04-28 12:50:35.424776", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:50:37.156 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:37 +0000 (0:00:00.109) 0:01:15.575 ********* 2020-04-28T12:50:37.612 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:50:37.612 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078237.08-216154468365064/source", "state": "file", "uid": 0} 2020-04-28T12:50:37.721 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078237.19-28177483202946/source", "state": "file", "uid": 0} 2020-04-28T12:50:38.141 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078237.62-211831880815649/source", "state": "file", "uid": 0} 2020-04-28T12:50:38.243 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078237.73-70458874554872/source", "state": "file", "uid": 0} 2020-04-28T12:50:38.690 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078238.17-89237140259951/source", "state": "file", "uid": 0} 2020-04-28T12:50:38.761 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:38 +0000 (0:00:01.600) 0:01:17.175 ********* 2020-04-28T12:50:38.763 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588078238.25-146684832506794/source", "state": "file", "uid": 0} 2020-04-28T12:50:38.807 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:38 +0000 (0:00:00.050) 0:01:17.226 ********* 2020-04-28T12:50:39.260 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-28T12:50:39.260 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:50:39.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:39 +0000 (0:00:00.504) 0:01:17.731 ********* 2020-04-28T12:50:39.323 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:50:39.365 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:39 +0000 (0:00:00.053) 0:01:17.784 ********* 2020-04-28T12:50:39.823 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:50:39.823 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:50:39.857 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:50:40.300 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:50:40.333 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:50:40.782 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:50:40.828 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:40 +0000 (0:00:01.462) 0:01:19.247 ********* 2020-04-28T12:50:40.836 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:50:40.880 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:40 +0000 (0:00:00.052) 0:01:19.299 ********* 2020-04-28T12:50:41.327 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:50:41.327 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.283888", "end": "2020-04-28 12:50:41.292619", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:50:41.008731", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:50:41.329 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:50:41.382 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.502) 0:01:19.801 ********* 2020-04-28T12:50:41.388 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.291925", "end": "2020-04-28 12:50:41.356570", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:50:41.064645", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:50:41.440 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.058) 0:01:19.859 ********* 2020-04-28T12:50:41.446 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:50:41.447 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.487 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.046) 0:01:19.906 ********* 2020-04-28T12:50:41.496 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.540 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.052) 0:01:19.959 ********* 2020-04-28T12:50:41.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:50:41.546 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.548 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.591 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.051) 0:01:20.010 ********* 2020-04-28T12:50:41.597 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.598 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.640 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.049) 0:01:20.059 ********* 2020-04-28T12:50:41.645 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:50:41.646 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.685 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.044) 0:01:20.104 ********* 2020-04-28T12:50:41.690 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.733 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.048) 0:01:20.152 ********* 2020-04-28T12:50:41.740 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:50:41.742 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:50:41.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.044) 0:01:20.197 ********* 2020-04-28T12:50:41.784 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:50:41.821 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.043) 0:01:20.240 ********* 2020-04-28T12:50:41.826 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:50:41.827 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.869 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.047) 0:01:20.288 ********* 2020-04-28T12:50:41.874 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.916 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.047) 0:01:20.335 ********* 2020-04-28T12:50:41.921 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:50:41.921 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:41.958 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:41 +0000 (0:00:00.041) 0:01:20.377 ********* 2020-04-28T12:50:41.972 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:42.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:42 +0000 (0:00:00.049) 0:01:20.426 ********* 2020-04-28T12:50:42.180 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:50:42.181 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006747", "end": "2020-04-28 12:50:42.150596", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:50:42.143849", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:50:42.218 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:42 +0000 (0:00:00.211) 0:01:20.637 ********* 2020-04-28T12:50:42.225 INFO:teuthology.task.ansible.out:fatal: [smithi176.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006371", "end": "2020-04-28 12:50:42.197441", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:50:42.191070", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:50:42.273 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:42 +0000 (0:00:00.054) 0:01:20.692 ********* 2020-04-28T12:50:42.278 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:50:42.279 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:42.318 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:42 +0000 (0:00:00.044) 0:01:20.737 ********* 2020-04-28T12:50:42.323 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:50:42.362 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:42 +0000 (0:00:00.043) 0:01:20.780 ********* 2020-04-28T12:50:44.467 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:50:44.468 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:50:44.508 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:44 +0000 (0:00:02.146) 0:01:22.927 ********* 2020-04-28T12:50:44.536 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:50:44.575 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:44 +0000 (0:00:00.066) 0:01:22.993 ********* 2020-04-28T12:50:47.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:50:47.672 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:50:47.710 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:47 +0000 (0:00:03.135) 0:01:26.129 ********* 2020-04-28T12:50:47.750 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:50:47.800 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:47 +0000 (0:00:00.089) 0:01:26.218 ********* 2020-04-28T12:50:52.777 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-28T12:50:52.778 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.851214", "end": "2020-04-28 12:50:52.755623", "rc": 0, "start": "2020-04-28 12:50:47.904409", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 135 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 53 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 124 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:50:48 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:50:52.780 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 135 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 53 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 124 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:50:48 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:50:52.816 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:52 +0000 (0:00:05.016) 0:01:31.235 ********* 2020-04-28T12:50:52.894 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.865374", "end": "2020-04-28 12:50:52.856826", "rc": 0, "start": "2020-04-28 12:50:47.991452", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 134 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 82 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:50:48 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:50:52.896 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 134 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 82 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:50:48 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:50:52.937 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:50:52 +0000 (0:00:00.120) 0:01:31.356 ********* 2020-04-28T12:51:00.472 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:51:00.473 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:51:00.510 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:00 +0000 (0:00:07.573) 0:01:38.929 ********* 2020-04-28T12:51:00.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:51:00.549 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:00.589 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:00 +0000 (0:00:00.078) 0:01:39.008 ********* 2020-04-28T12:51:00.620 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:51:00.621 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:51:00.671 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:00 +0000 (0:00:00.082) 0:01:39.090 ********* 2020-04-28T12:51:00.711 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:51:00.712 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:00.753 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:00 +0000 (0:00:00.081) 0:01:39.172 ********* 2020-04-28T12:51:01.528 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:51:01.565 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:01 +0000 (0:00:00.811) 0:01:39.984 ********* 2020-04-28T12:51:01.605 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:51:01.606 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:01.643 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:01 +0000 (0:00:00.077) 0:01:40.062 ********* 2020-04-28T12:51:01.692 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:51:01.692 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:51:01.738 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:01 +0000 (0:00:00.095) 0:01:40.157 ********* 2020-04-28T12:51:01.769 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:01.805 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:01 +0000 (0:00:00.066) 0:01:40.224 ********* 2020-04-28T12:51:01.962 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service basic.target polkit.service dbus.socket system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service shutdown.target iptables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-04-28T12:51:01.964 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-04-28T12:51:01.965 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-04-28T12:51:01.967 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:51:02.006 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:01 +0000 (0:00:00.200) 0:01:40.425 ********* 2020-04-28T12:51:02.132 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket system.slice polkit.service dbus.service sysinit.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target iptables.service ipset.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:51:02.134 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", 2020-04-28T12:51:02.135 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:51:02.137 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:51:02.187 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:02 +0000 (0:00:00.180) 0:01:40.606 ********* 2020-04-28T12:51:02.302 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-28T12:51:02.304 INFO:teuthology.task.ansible.out:fatal: [smithi176.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:51:02.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:02 +0000 (0:00:00.154) 0:01:40.760 ********* 2020-04-28T12:51:02.508 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:51:02.546 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:02 +0000 (0:00:00.204) 0:01:40.965 ********* 2020-04-28T12:51:03.068 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:51:03.108 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.561) 0:01:41.527 ********* 2020-04-28T12:51:03.114 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:51:03.159 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.051) 0:01:41.578 ********* 2020-04-28T12:51:03.169 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.203 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.044) 0:01:41.622 ********* 2020-04-28T12:51:03.209 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.247 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.043) 0:01:41.666 ********* 2020-04-28T12:51:03.255 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:51:03.294 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.045) 0:01:41.711 ********* 2020-04-28T12:51:03.340 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.047) 0:01:41.759 ********* 2020-04-28T12:51:03.346 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:51:03.347 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.046) 0:01:41.806 ********* 2020-04-28T12:51:03.394 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.433 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.045) 0:01:41.852 ********* 2020-04-28T12:51:03.439 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-28T12:51:03.441 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.478 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.044) 0:01:41.897 ********* 2020-04-28T12:51:03.486 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.528 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.049) 0:01:41.947 ********* 2020-04-28T12:51:03.533 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:51:03.533 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.535 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.585 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.057) 0:01:42.004 ********* 2020-04-28T12:51:03.592 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.593 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.632 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.047) 0:01:42.051 ********* 2020-04-28T12:51:03.638 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:51:03.639 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.677 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.044) 0:01:42.095 ********* 2020-04-28T12:51:03.685 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.723 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.046) 0:01:42.142 ********* 2020-04-28T12:51:03.729 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:51:03.769 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.045) 0:01:42.188 ********* 2020-04-28T12:51:03.813 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.044) 0:01:42.232 ********* 2020-04-28T12:51:03.821 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-28T12:51:03.823 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.862 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.048) 0:01:42.281 ********* 2020-04-28T12:51:03.868 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.907 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.045) 0:01:42.326 ********* 2020-04-28T12:51:03.909 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:03.915 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:51:03.915 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:03.962 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:03 +0000 (0:00:00.055) 0:01:42.381 ********* 2020-04-28T12:51:03.970 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.010 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:42.429 ********* 2020-04-28T12:51:04.016 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-28T12:51:04.017 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.056 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:42.475 ********* 2020-04-28T12:51:04.063 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.103 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:42.522 ********* 2020-04-28T12:51:04.109 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:51:04.111 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.150 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:42.569 ********* 2020-04-28T12:51:04.159 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.198 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:42.617 ********* 2020-04-28T12:51:04.204 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:51:04.204 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.243 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.044) 0:01:42.662 ********* 2020-04-28T12:51:04.251 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.287 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.044) 0:01:42.706 ********* 2020-04-28T12:51:04.294 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.346 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.058) 0:01:42.765 ********* 2020-04-28T12:51:04.354 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:42.811 ********* 2020-04-28T12:51:04.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-28T12:51:04.398 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.442 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:42.858 ********* 2020-04-28T12:51:04.446 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.485 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:42.904 ********* 2020-04-28T12:51:04.487 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:04.500 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:51:04.502 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.542 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.056) 0:01:42.961 ********* 2020-04-28T12:51:04.548 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.589 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:43.008 ********* 2020-04-28T12:51:04.594 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-28T12:51:04.595 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.635 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:43.054 ********* 2020-04-28T12:51:04.646 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.683 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:43.101 ********* 2020-04-28T12:51:04.688 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:51:04.688 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.729 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.046) 0:01:43.148 ********* 2020-04-28T12:51:04.738 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.048) 0:01:43.197 ********* 2020-04-28T12:51:04.784 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:51:04.785 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.826 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:43.244 ********* 2020-04-28T12:51:04.832 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.873 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.047) 0:01:43.292 ********* 2020-04-28T12:51:04.878 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:51:04.880 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.044) 0:01:43.336 ********* 2020-04-28T12:51:04.926 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:04.965 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:04 +0000 (0:00:00.048) 0:01:43.384 ********* 2020-04-28T12:51:04.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-28T12:51:04.971 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.011 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.045) 0:01:43.430 ********* 2020-04-28T12:51:05.018 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.060 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.048) 0:01:43.479 ********* 2020-04-28T12:51:05.066 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:51:05.067 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.108 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.047) 0:01:43.527 ********* 2020-04-28T12:51:05.114 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.158 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.050) 0:01:43.577 ********* 2020-04-28T12:51:05.166 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:51:05.168 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.208 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.049) 0:01:43.627 ********* 2020-04-28T12:51:05.215 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.257 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.048) 0:01:43.676 ********* 2020-04-28T12:51:05.262 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:51:05.263 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.047) 0:01:43.724 ********* 2020-04-28T12:51:05.311 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.352 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.047) 0:01:43.771 ********* 2020-04-28T12:51:05.357 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:51:05.358 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.398 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.046) 0:01:43.817 ********* 2020-04-28T12:51:05.407 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.047) 0:01:43.864 ********* 2020-04-28T12:51:05.451 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:51:05.451 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.496 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.050) 0:01:43.914 ********* 2020-04-28T12:51:05.503 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.544 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.048) 0:01:43.963 ********* 2020-04-28T12:51:05.550 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:51:05.551 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.590 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.045) 0:01:44.008 ********* 2020-04-28T12:51:05.596 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.634 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.044) 0:01:44.053 ********* 2020-04-28T12:51:05.639 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:51:05.642 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.680 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.045) 0:01:44.099 ********* 2020-04-28T12:51:05.686 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.745 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.065) 0:01:44.164 ********* 2020-04-28T12:51:05.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.790 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.044) 0:01:44.209 ********* 2020-04-28T12:51:05.797 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.835 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.044) 0:01:44.254 ********* 2020-04-28T12:51:05.842 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.882 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.043) 0:01:44.298 ********* 2020-04-28T12:51:05.894 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.935 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.052) 0:01:44.350 ********* 2020-04-28T12:51:05.937 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:05.938 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:05.978 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:05 +0000 (0:00:00.046) 0:01:44.397 ********* 2020-04-28T12:51:05.984 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.044) 0:01:44.442 ********* 2020-04-28T12:51:06.028 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:51:06.028 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.066 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.043) 0:01:44.485 ********* 2020-04-28T12:51:06.072 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.112 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.044) 0:01:44.530 ********* 2020-04-28T12:51:06.117 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:51:06.118 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.156 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.044) 0:01:44.575 ********* 2020-04-28T12:51:06.162 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.205 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.049) 0:01:44.624 ********* 2020-04-28T12:51:06.213 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:51:06.214 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.251 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.046) 0:01:44.670 ********* 2020-04-28T12:51:06.258 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.298 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.047) 0:01:44.717 ********* 2020-04-28T12:51:06.303 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:51:06.304 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.046) 0:01:44.764 ********* 2020-04-28T12:51:06.352 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:06.394 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.048) 0:01:44.813 ********* 2020-04-28T12:51:06.567 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:51:06.568 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:51:06.627 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.232) 0:01:45.045 ********* 2020-04-28T12:51:06.634 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:51:06.680 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.052) 0:01:45.098 ********* 2020-04-28T12:51:06.846 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:51:06.846 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:51:06.889 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.209) 0:01:45.308 ********* 2020-04-28T12:51:06.906 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:51:06.945 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:06 +0000 (0:00:00.055) 0:01:45.364 ********* 2020-04-28T12:51:07.102 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:51:07.103 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:51:07.149 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.204) 0:01:45.568 ********* 2020-04-28T12:51:07.170 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:51:07.171 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:51:07.173 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.212 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.062) 0:01:45.630 ********* 2020-04-28T12:51:07.262 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.050) 0:01:45.681 ********* 2020-04-28T12:51:07.269 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.312 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.050) 0:01:45.731 ********* 2020-04-28T12:51:07.318 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:51:07.318 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.358 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.045) 0:01:45.777 ********* 2020-04-28T12:51:07.364 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:51:07.365 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.403 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.044) 0:01:45.822 ********* 2020-04-28T12:51:07.409 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:51:07.410 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.449 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.045) 0:01:45.867 ********* 2020-04-28T12:51:07.456 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:51:07.457 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.493 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.044) 0:01:45.912 ********* 2020-04-28T12:51:07.499 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:51:07.500 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.541 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.048) 0:01:45.960 ********* 2020-04-28T12:51:07.549 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:51:07.551 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.596 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.054) 0:01:46.014 ********* 2020-04-28T12:51:07.602 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:51:07.604 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.650 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.051) 0:01:46.066 ********* 2020-04-28T12:51:07.658 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.702 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.055) 0:01:46.121 ********* 2020-04-28T12:51:07.710 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:51:07.711 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.046) 0:01:46.167 ********* 2020-04-28T12:51:07.755 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:51:07.756 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.794 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.045) 0:01:46.213 ********* 2020-04-28T12:51:07.799 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:51:07.800 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.843 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.048) 0:01:46.262 ********* 2020-04-28T12:51:07.848 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:51:07.850 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.893 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.050) 0:01:46.312 ********* 2020-04-28T12:51:07.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:51:07.900 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.942 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.048) 0:01:46.361 ********* 2020-04-28T12:51:07.952 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:07.986 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:07 +0000 (0:00:00.044) 0:01:46.405 ********* 2020-04-28T12:51:07.991 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:51:07.992 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.031 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.044) 0:01:46.450 ********* 2020-04-28T12:51:08.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:51:08.041 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.077 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.045) 0:01:46.496 ********* 2020-04-28T12:51:08.083 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:51:08.084 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.044) 0:01:46.541 ********* 2020-04-28T12:51:08.127 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:51:08.128 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.167 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.045) 0:01:46.586 ********* 2020-04-28T12:51:08.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:51:08.175 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.043) 0:01:46.630 ********* 2020-04-28T12:51:08.216 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:51:08.218 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.260 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.049) 0:01:46.679 ********* 2020-04-28T12:51:08.271 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.307 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.046) 0:01:46.726 ********* 2020-04-28T12:51:08.311 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:51:08.313 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.350 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.043) 0:01:46.769 ********* 2020-04-28T12:51:08.356 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:51:08.357 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.395 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.044) 0:01:46.814 ********* 2020-04-28T12:51:08.400 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:51:08.400 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.440 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.045) 0:01:46.859 ********* 2020-04-28T12:51:08.449 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:51:08.451 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.487 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.047) 0:01:46.906 ********* 2020-04-28T12:51:08.493 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:51:08.493 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.532 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.044) 0:01:46.951 ********* 2020-04-28T12:51:08.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:51:08.538 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.579 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.046) 0:01:46.998 ********* 2020-04-28T12:51:08.584 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:51:08.585 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.624 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.045) 0:01:47.043 ********* 2020-04-28T12:51:08.630 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.668 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.043) 0:01:47.087 ********* 2020-04-28T12:51:08.673 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:51:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.711 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.043) 0:01:47.130 ********* 2020-04-28T12:51:08.721 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.755 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.043) 0:01:47.174 ********* 2020-04-28T12:51:08.763 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:51:08.764 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.801 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.045) 0:01:47.220 ********* 2020-04-28T12:51:08.807 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:51:08.808 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.848 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.046) 0:01:47.267 ********* 2020-04-28T12:51:08.853 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:51:08.854 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.892 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.044) 0:01:47.311 ********* 2020-04-28T12:51:08.898 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:51:08.899 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.939 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.047) 0:01:47.358 ********* 2020-04-28T12:51:08.945 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:51:08.947 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:08.988 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:08 +0000 (0:00:00.048) 0:01:47.407 ********* 2020-04-28T12:51:08.995 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:51:08.996 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.037 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.046) 0:01:47.453 ********* 2020-04-28T12:51:09.041 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:51:09.042 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.045) 0:01:47.499 ********* 2020-04-28T12:51:09.086 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:51:09.087 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.137 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.057) 0:01:47.556 ********* 2020-04-28T12:51:09.143 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:51:09.143 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.184 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.046) 0:01:47.603 ********* 2020-04-28T12:51:09.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:51:09.190 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.051) 0:01:47.654 ********* 2020-04-28T12:51:09.245 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:09.247 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:51:09.286 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.050) 0:01:47.705 ********* 2020-04-28T12:51:09.293 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:51:09.300 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.354 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.064) 0:01:47.770 ********* 2020-04-28T12:51:09.357 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:51:09.358 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.359 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:51:09.360 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.376 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.383 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.385 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:09.386 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:51:09.440 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.089) 0:01:47.859 ********* 2020-04-28T12:51:09.478 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.038) 0:01:47.897 ********* 2020-04-28T12:51:09.527 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.538 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:51:09.549 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.566 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.566 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.578 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.590 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.642 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.159) 0:01:48.056 ********* 2020-04-28T12:51:09.644 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:51:09.645 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004390", "end": "2020-04-28 12:51:09.571977", "rc": 0, "start": "2020-04-28 12:51:09.567587", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:51:09.692 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.054) 0:01:48.111 ********* 2020-04-28T12:51:09.729 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:51:09.731 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.775 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.083) 0:01:48.194 ********* 2020-04-28T12:51:09.780 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:51:09.781 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003639", "end": "2020-04-28 12:51:09.757224", "rc": 0, "start": "2020-04-28 12:51:09.753585", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:51:09.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.048) 0:01:48.243 ********* 2020-04-28T12:51:09.830 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-28T12:51:09.831 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.878 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.053) 0:01:48.297 ********* 2020-04-28T12:51:09.890 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.929 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.050) 0:01:48.348 ********* 2020-04-28T12:51:09.936 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:09.977 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:09 +0000 (0:00:00.048) 0:01:48.396 ********* 2020-04-28T12:51:09.984 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-28T12:51:09.985 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:10.022 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:10 +0000 (0:00:00.044) 0:01:48.441 ********* 2020-04-28T12:51:10.028 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:51:10.031 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:10.071 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:10 +0000 (0:00:00.047) 0:01:48.489 ********* 2020-04-28T12:51:10.077 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:10.121 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:10 +0000 (0:00:00.044) 0:01:48.534 ********* 2020-04-28T12:51:10.141 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:51:10.142 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:10.180 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:10 +0000 (0:00:00.064) 0:01:48.599 ********* 2020-04-28T12:51:11.040 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:51:11.047 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:51:11.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.897) 0:01:49.496 ********* 2020-04-28T12:51:11.116 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:51:11.117 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:51:11.156 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.078) 0:01:49.574 ********* 2020-04-28T12:51:11.162 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:51:11.162 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:51:11.202 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.046) 0:01:49.621 ********* 2020-04-28T12:51:11.239 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:51:11.240 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:51:11.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.111) 0:01:49.732 ********* 2020-04-28T12:51:11.351 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:51:11.352 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005092", "end": "2020-04-28 12:51:11.328663", "rc": 0, "start": "2020-04-28 12:51:11.323571", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:11.389 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.075) 0:01:49.808 ********* 2020-04-28T12:51:11.428 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:51:11.430 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:11.466 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.077) 0:01:49.885 ********* 2020-04-28T12:51:11.492 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:51:11.530 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.063) 0:01:49.949 ********* 2020-04-28T12:51:11.537 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:51:11.538 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005002", "end": "2020-04-28 12:51:11.490912", "rc": 0, "start": "2020-04-28 12:51:11.485910", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:11.578 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.047) 0:01:49.997 ********* 2020-04-28T12:51:11.595 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:51:11.596 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:51:11.597 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:11.639 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:51:11.641 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:11.676 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.098) 0:01:50.095 ********* 2020-04-28T12:51:11.715 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:51:11.758 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:11 +0000 (0:00:00.079) 0:01:50.175 ********* 2020-04-28T12:51:11.816 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:51:11.817 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKB1', u'wwn-0x5000c50092937c6b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKB1', u'wwn': u'0x5000c50092937c6b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKB1-part1', u'wwn-0x5000c50092937c6b-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKB1", "wwn-0x5000c50092937c6b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKB1-part1", "wwn-0x5000c50092937c6b-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKB1", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:51:11.819 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092937c6b"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:13.133 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-1I1yS4-3I3l-FmzU-rF5G-1u0T-kZ1s-GtaFY6', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.352764", "end": "2020-04-28 12:51:13.092435", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1I1yS4-3I3l-FmzU-rF5G-1u0T-kZ1s-GtaFY6", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:11.739671", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:51:13.135 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:13.354 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-141m6i-gx5L-70L2-5vyK-ESMt-dliG-O5Woir', u'nvme-INTEL_SSDPEDMD400G4_CVFT62330099400BGN', u'nvme-nvme.8086-43564654363233333030393934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.366651", "end": "2020-04-28 12:51:13.320430", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-141m6i-gx5L-70L2-5vyK-ESMt-dliG-O5Woir", "nvme-INTEL_SSDPEDMD400G4_CVFT62330099400BGN", "nvme-nvme.8086-43564654363233333030393934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:11.953779", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:51:13.356 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:14.378 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPT3SpTy7DylXrceIjLtBANLT6pWr273Pxw'], u'uuids': [u'31e16e24-6874-4a98-b41e-b7d6a57a1202']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.040825", "end": "2020-04-28 12:51:14.333972", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPT3SpTy7DylXrceIjLtBANLT6pWr273Pxw"], "labels": [], "masters": [], "uuids": ["31e16e24-6874-4a98-b41e-b7d6a57a1202"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:13.293147", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:14.620 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfYgIbz0NGEOJiqiI7x24hCX1naIWCBVuw'], u'uuids': [u'20df2ba7-139d-4a32-8265-6e21df0f7137']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.064143", "end": "2020-04-28 12:51:14.584536", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfYgIbz0NGEOJiqiI7x24hCX1naIWCBVuw"], "labels": [], "masters": [], "uuids": ["20df2ba7-139d-4a32-8265-6e21df0f7137"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:13.520393", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:15.616 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcWE9Ms6Kn5e8zhPoYJmBCpyc4JEZEsPy'], u'uuids': [u'065565c6-7eb8-4744-8665-a6f095ac2dc1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.047316", "end": "2020-04-28 12:51:15.576122", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcWE9Ms6Kn5e8zhPoYJmBCpyc4JEZEsPy"], "labels": [], "masters": [], "uuids": ["065565c6-7eb8-4744-8665-a6f095ac2dc1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:14.528806", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:15.867 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyf3gHP7VMbHSXn6oMcA9m7pSTeu1TPyabe'], u'uuids': [u'8d28c2f4-0581-41a1-8b2f-2b37d88b5e5a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.036957", "end": "2020-04-28 12:51:15.829119", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyf3gHP7VMbHSXn6oMcA9m7pSTeu1TPyabe"], "labels": [], "masters": [], "uuids": ["8d28c2f4-0581-41a1-8b2f-2b37d88b5e5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:14.792162", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:16.858 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTUXRHOw9wc2j3npLSLlGopTcDl8WADFzK'], u'uuids': [u'b74f2da4-5cf8-44e6-b9bc-ed7303276bcb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051342", "end": "2020-04-28 12:51:16.818306", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTUXRHOw9wc2j3npLSLlGopTcDl8WADFzK"], "labels": [], "masters": [], "uuids": ["b74f2da4-5cf8-44e6-b9bc-ed7303276bcb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:15.766964", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:17.105 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfQ8UffOERaUwbcU52XnMxcslr5l2FQF1E'], u'uuids': [u'ed06d650-1b30-4adf-adff-439de6da5526']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.034293", "end": "2020-04-28 12:51:17.063306", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfQ8UffOERaUwbcU52XnMxcslr5l2FQF1E"], "labels": [], "masters": [], "uuids": ["ed06d650-1b30-4adf-adff-439de6da5526"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:16.029013", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:18.092 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcNfW2nAhKMPZ67uvo7l7Pa2UEEKVDsci'], u'uuids': [u'f80216c1-e1ca-4f56-a074-6ac7bea2f095']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.045795", "end": "2020-04-28 12:51:18.059693", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcNfW2nAhKMPZ67uvo7l7Pa2UEEKVDsci"], "labels": [], "masters": [], "uuids": ["f80216c1-e1ca-4f56-a074-6ac7bea2f095"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:17.013898", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:18.335 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfagGcCcrduMVyz5pHBUkA1wuMYml1srPe'], u'uuids': [u'6587d61a-8f5d-45ae-839a-62f4de184408']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.038822", "end": "2020-04-28 12:51:18.304558", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfagGcCcrduMVyz5pHBUkA1wuMYml1srPe"], "labels": [], "masters": [], "uuids": ["6587d61a-8f5d-45ae-839a-62f4de184408"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:17.265736", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:19.336 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTSiGi0andgvE49bwNWKgdqTEPlLQSNb8P'], u'uuids': [u'6f38c85a-3383-420d-b429-628093a34615']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.049673", "end": "2020-04-28 12:51:19.302171", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTSiGi0andgvE49bwNWKgdqTEPlLQSNb8P"], "labels": [], "masters": [], "uuids": ["6f38c85a-3383-420d-b429-628093a34615"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:18.252498", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:19.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:19 +0000 (0:00:07.631) 0:01:57.806 ********* 2020-04-28T12:51:19.436 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:51:19.437 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:51:19.438 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:19.595 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:51:19.596 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfwBg9fLN44gpfCHRAF14PrEwnTHLrgISz'], u'uuids': [u'021901a1-889a-42c2-a265-d55148acea7d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.050405", "end": "2020-04-28 12:51:19.563688", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfwBg9fLN44gpfCHRAF14PrEwnTHLrgISz"], "labels": [], "masters": [], "uuids": ["021901a1-889a-42c2-a265-d55148acea7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:18.513283", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:51:19.651 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:19 +0000 (0:00:00.263) 0:01:58.070 ********* 2020-04-28T12:51:19.667 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:51:19.668 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-1I1yS4-3I3l-FmzU-rF5G-1u0T-kZ1s-GtaFY6', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037505", "end": "2020-04-28 12:51:19.636008", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1I1yS4-3I3l-FmzU-rF5G-1u0T-kZ1s-GtaFY6", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:19.598503", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:51:19.670 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0348845 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0348845 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:19.713 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKB1', u'wwn-0x5000c50092937c6b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKB1', u'wwn': u'0x5000c50092937c6b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKB1-part1', u'wwn-0x5000c50092937c6b-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKB1", "wwn-0x5000c50092937c6b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKB1-part1", "wwn-0x5000c50092937c6b-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKB1", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:51:19.714 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092937c6b"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:19.949 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-141m6i-gx5L-70L2-5vyK-ESMt-dliG-O5Woir', u'nvme-INTEL_SSDPEDMD400G4_CVFT62330099400BGN', u'nvme-nvme.8086-43564654363233333030393934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036144", "end": "2020-04-28 12:51:19.918984", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-141m6i-gx5L-70L2-5vyK-ESMt-dliG-O5Woir", "nvme-INTEL_SSDPEDMD400G4_CVFT62330099400BGN", "nvme-nvme.8086-43564654363233333030393934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:19.882840", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:51:19.950 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0336505 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0336505 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.003 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPT3SpTy7DylXrceIjLtBANLT6pWr273Pxw'], u'uuids': [u'31e16e24-6874-4a98-b41e-b7d6a57a1202']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140680", "end": "2020-04-28 12:51:19.968121", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPT3SpTy7DylXrceIjLtBANLT6pWr273Pxw"], "labels": [], "masters": [], "uuids": ["31e16e24-6874-4a98-b41e-b7d6a57a1202"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:19.827441", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13807 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13807 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.293 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfYgIbz0NGEOJiqiI7x24hCX1naIWCBVuw'], u'uuids': [u'20df2ba7-139d-4a32-8265-6e21df0f7137']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141354", "end": "2020-04-28 12:51:20.254678", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfYgIbz0NGEOJiqiI7x24hCX1naIWCBVuw"], "labels": [], "masters": [], "uuids": ["20df2ba7-139d-4a32-8265-6e21df0f7137"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.113324", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138724 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138724 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.347 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcWE9Ms6Kn5e8zhPoYJmBCpyc4JEZEsPy'], u'uuids': [u'065565c6-7eb8-4744-8665-a6f095ac2dc1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139963", "end": "2020-04-28 12:51:20.308466", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcWE9Ms6Kn5e8zhPoYJmBCpyc4JEZEsPy"], "labels": [], "masters": [], "uuids": ["065565c6-7eb8-4744-8665-a6f09 2020-04-28T12:51:20.347 INFO:teuthology.task.ansible.out:5ac2dc1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.168503", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137392 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137392 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.608 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyf3gHP7VMbHSXn6oMcA9m7pSTeu1TPyabe'], u'uuids': [u'8d28c2f4-0581-41a1-8b2f-2b37d88b5e5a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140055", "end": "2020-04-28 12:51:20.578699", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyf3gHP7VMbHSXn6oMcA9m7pSTeu1TPyabe"], "labels": [], "masters": [], "uuids": ["8d28c2f4-0581-41a1-8b2f-2b37d 2020-04-28T12:51:20.610 INFO:teuthology.task.ansible.out:88b5e5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.438644", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1376 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1376 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.683 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTUXRHOw9wc2j3npLSLlGopTcDl8WADFzK'], u'uuids': [u'b74f2da4-5cf8-44e6-b9bc-ed7303276bcb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140501", "end": "2020-04-28 12:51:20.653591", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTUXRHOw9wc2j3npLSLlGopTcDl8WADFzK"], "labels": [], "masters": [], "uuids": ["b74f2da4-5cf8-44e6-b9bc-ed730 2020-04-28T12:51:20.685 INFO:teuthology.task.ansible.out:3276bcb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.513090", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137999 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137999 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:20.938 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfQ8UffOERaUwbcU52XnMxcslr5l2FQF1E'], u'uuids': [u'ed06d650-1b30-4adf-adff-439de6da5526']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138156", "end": "2020-04-28 12:51:20.903296", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfQ8UffOERaUwbcU52XnMxcslr5l2FQF1E"], "labels": [], "masters": [], "uuids": ["ed06d650-1b30-4adf-adff-439de6da5526"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.765140", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135556 s, 851 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135556 s, 851 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.018 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcNfW2nAhKMPZ67uvo7l7Pa2UEEKVDsci'], u'uuids': [u'f80216c1-e1ca-4f56-a074-6ac7bea2f095']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.151388", "end": "2020-04-28 12:51:20.987326", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTcNfW2nAhKMPZ67uvo7l7Pa2UEEKVDsci"], "labels": [], "masters": [], "uuids": ["f80216c1-e1ca-4f56-a074-6ac7bea2f095"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:20.835938", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148771 s, 775 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148771 s, 775 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.278 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfagGcCcrduMVyz5pHBUkA1wuMYml1srPe'], u'uuids': [u'6587d61a-8f5d-45ae-839a-62f4de184408']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.150599", "end": "2020-04-28 12:51:21.253410", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfagGcCcrduMVyz5pHBUkA1wuMYml1srPe"], "labels": [], "masters": [], "uuids": ["6587d61a-8f5d-45ae-839a-62f4de184408"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:21.102811", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147998 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147998 s, 779 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.342 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTSiGi0andgvE49bwNWKgdqTEPlLQSNb8P'], u'uuids': [u'6f38c85a-3383-420d-b429-628093a34615']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140676", "end": "2020-04-28 12:51:21.311653", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tX4AxQtPgybUl3V52gw99bWl2e1hIfPTSiGi0andgvE49bwNWKgdqTEPlLQSNb8P"], "labels": [], "masters": [], "uuids": ["6f38c85a-3383-420d-b429-62809 2020-04-28T12:51:21.344 INFO:teuthology.task.ansible.out:3a34615"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:21.170977", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13812 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13812 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:21 +0000 (0:00:01.739) 0:01:59.809 ********* 2020-04-28T12:51:21.609 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfwBg9fLN44gpfCHRAF14PrEwnTHLrgISz'], u'uuids': [u'021901a1-889a-42c2-a265-d55148acea7d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.142063", "end": "2020-04-28 12:51:21.579726", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zv3BKDfFFn5UYRpnWY2DLEYStLLNyAyfwBg9fLN44gpfCHRAF14PrEwnTHLrgISz"], "labels": [], "masters": [], "uuids": ["021901a1-889a-42c2-a265-d55148acea7d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:51:21.437663", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139533 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139533 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.667 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:21 +0000 (0:00:00.276) 0:02:00.086 ********* 2020-04-28T12:51:21.673 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-28T12:51:21.673 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.069853", "end": "2020-04-28 12:51:21.627356", "rc": 0, "start": "2020-04-28 12:51:21.557503", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.716 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:21 +0000 (0:00:00.049) 0:02:00.135 ********* 2020-04-28T12:51:21.922 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.057154", "end": "2020-04-28 12:51:21.891105", "rc": 0, "start": "2020-04-28 12:51:21.833951", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:21.966 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:21 +0000 (0:00:00.249) 0:02:00.384 ********* 2020-04-28T12:51:21.972 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:51:21.973 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052808", "end": "2020-04-28 12:51:21.936129", "rc": 0, "start": "2020-04-28 12:51:21.883321", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:22.016 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.050) 0:02:00.435 ********* 2020-04-28T12:51:22.044 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:51:22.087 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.070) 0:02:00.506 ********* 2020-04-28T12:51:22.125 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-28T12:51:22.126 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.192 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.104) 0:02:00.611 ********* 2020-04-28T12:51:22.201 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:51:22.210 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.037710", "end": "2020-04-28 12:51:22.168749", "rc": 0, "start": "2020-04-28 12:51:22.131039", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:22.244 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.052) 0:02:00.663 ********* 2020-04-28T12:51:22.250 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:51:22.251 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.299 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.049) 0:02:00.713 ********* 2020-04-28T12:51:22.300 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:51:22.347 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.053) 0:02:00.766 ********* 2020-04-28T12:51:22.354 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:51:22.355 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.398 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.050) 0:02:00.817 ********* 2020-04-28T12:51:22.405 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-28T12:51:22.407 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.451 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.052) 0:02:00.870 ********* 2020-04-28T12:51:22.456 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-28T12:51:22.456 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.498 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.047) 0:02:00.917 ********* 2020-04-28T12:51:22.504 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:51:22.504 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.548 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.050) 0:02:00.967 ********* 2020-04-28T12:51:22.575 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:51:22.576 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.070) 0:02:01.038 ********* 2020-04-28T12:51:22.645 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-28T12:51:22.646 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.684 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.065) 0:02:01.103 ********* 2020-04-28T12:51:22.690 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:51:22.691 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:51:22.732 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.047) 0:02:01.151 ********* 2020-04-28T12:51:22.780 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:51:22.781 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.821 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.089) 0:02:01.240 ********* 2020-04-28T12:51:22.858 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:51:22.860 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:22.907 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.086) 0:02:01.326 ********* 2020-04-28T12:51:22.915 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:51:22.915 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:51:22.958 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.050) 0:02:01.377 ********* 2020-04-28T12:51:22.963 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:22.964 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.005 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:22 +0000 (0:00:00.047) 0:02:01.424 ********* 2020-04-28T12:51:23.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:51:23.013 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={u'block_used': 12909662, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185446, u'size_available': 930551586816, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989724, u'device': u'/dev/sda1', u'inode_used': 65252, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185446, "block_size": 4096, "block_total": 240095108, "block_used": 12909662, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989724, "inode_total": 61054976, "inode_used": 65252, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551586816, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.053 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.047) 0:02:01.472 ********* 2020-04-28T12:51:23.059 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:23.061 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.100 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.047) 0:02:01.519 ********* 2020-04-28T12:51:23.106 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:51:23.109 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.052) 0:02:01.572 ********* 2020-04-28T12:51:23.158 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:51:23.162 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.197 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.043) 0:02:01.615 ********* 2020-04-28T12:51:23.201 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:23.202 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.247 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.050) 0:02:01.666 ********* 2020-04-28T12:51:23.254 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.045) 0:02:01.712 ********* 2020-04-28T12:51:23.298 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:23.299 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.337 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.044) 0:02:01.756 ********* 2020-04-28T12:51:23.345 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:51:23.346 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.384 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.046) 0:02:01.803 ********* 2020-04-28T12:51:23.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:51:23.392 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.430 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.045) 0:02:01.849 ********* 2020-04-28T12:51:23.456 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:51:23.457 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.494 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.064) 0:02:01.913 ********* 2020-04-28T12:51:23.530 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:51:23.532 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:23.574 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:23 +0000 (0:00:00.080) 0:02:01.993 ********* 2020-04-28T12:51:24.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-28T12:51:24.113 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:51:24.151 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:24 +0000 (0:00:00.576) 0:02:02.570 ********* 2020-04-28T12:51:24.161 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:51:24.197 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:24 +0000 (0:00:00.046) 0:02:02.616 ********* 2020-04-28T12:51:24.836 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:51:24.837 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:24.879 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.163 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.218 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.489 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.542 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.829 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:25.882 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:26.201 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:26.244 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:26 +0000 (0:00:02.046) 0:02:04.663 ********* 2020-04-28T12:51:26.252 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:51:26.297 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:26 +0000 (0:00:00.052) 0:02:04.715 ********* 2020-04-28T12:51:26.445 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:51:26.494 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:26 +0000 (0:00:00.197) 0:02:04.913 ********* 2020-04-28T12:51:26.511 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:51:26.561 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:26 +0000 (0:00:00.066) 0:02:04.980 ********* 2020-04-28T12:51:26.568 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:51:26.569 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:26.602 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:26.749 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:26.792 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:26.927 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:26.970 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:27.117 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:27.160 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:27.308 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:27.350 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.789) 0:02:05.769 ********* 2020-04-28T12:51:27.377 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:51:27.420 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.069) 0:02:05.839 ********* 2020-04-28T12:51:27.552 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:51:27.553 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:51:27.608 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.188) 0:02:06.027 ********* 2020-04-28T12:51:27.629 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:51:27.672 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.063) 0:02:06.091 ********* 2020-04-28T12:51:27.678 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-28T12:51:27.679 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:51:27.734 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.061) 0:02:06.153 ********* 2020-04-28T12:51:27.740 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:51:27.784 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:27 +0000 (0:00:00.049) 0:02:06.203 ********* 2020-04-28T12:51:28.341 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:51:28.343 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:51:28.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:28 +0000 (0:00:00.602) 0:02:06.806 ********* 2020-04-28T12:51:29.012 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:51:29.013 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:51:29.055 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.667) 0:02:07.474 ********* 2020-04-28T12:51:29.081 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:51:29.082 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.118 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.063) 0:02:07.537 ********* 2020-04-28T12:51:29.144 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:51:29.145 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.181 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.062) 0:02:07.600 ********* 2020-04-28T12:51:29.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:51:29.208 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.247 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.065) 0:02:07.665 ********* 2020-04-28T12:51:29.283 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:51:29.285 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.323 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.076) 0:02:07.742 ********* 2020-04-28T12:51:29.350 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:51:29.352 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.070) 0:02:07.812 ********* 2020-04-28T12:51:29.430 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.037) 0:02:07.849 ********* 2020-04-28T12:51:29.467 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:51:29.469 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.509 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.078) 0:02:07.928 ********* 2020-04-28T12:51:29.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:51:29.544 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.585 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.073) 0:02:08.002 ********* 2020-04-28T12:51:29.620 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-28T12:51:29.621 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.659 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.076) 0:02:08.078 ********* 2020-04-28T12:51:29.686 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-28T12:51:29.687 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.743 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.083) 0:02:08.162 ********* 2020-04-28T12:51:29.748 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:51:29.749 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:51:29.795 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.052) 0:02:08.214 ********* 2020-04-28T12:51:29.801 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:51:29.802 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.842 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.047) 0:02:08.261 ********* 2020-04-28T12:51:29.848 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:51:29.848 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.889 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.046) 0:02:08.307 ********* 2020-04-28T12:51:29.895 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:51:29.895 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.942 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.049) 0:02:08.357 ********* 2020-04-28T12:51:29.943 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:51:29.945 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:29.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:29 +0000 (0:00:00.046) 0:02:08.403 ********* 2020-04-28T12:51:30.010 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:51:30.011 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.048 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.063) 0:02:08.466 ********* 2020-04-28T12:51:30.075 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:51:30.077 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.112 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.064) 0:02:08.531 ********* 2020-04-28T12:51:30.149 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:51:30.151 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.189 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.076) 0:02:08.608 ********* 2020-04-28T12:51:30.215 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:51:30.217 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.253 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.064) 0:02:08.672 ********* 2020-04-28T12:51:30.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.317 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.064) 0:02:08.736 ********* 2020-04-28T12:51:30.350 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.389 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.072) 0:02:08.808 ********* 2020-04-28T12:51:30.415 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-28T12:51:30.416 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:51:30.418 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.455 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.065) 0:02:08.874 ********* 2020-04-28T12:51:30.490 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.035) 0:02:08.909 ********* 2020-04-28T12:51:30.494 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:51:30.494 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.535 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.044) 0:02:08.953 ********* 2020-04-28T12:51:30.561 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:51:30.562 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:30.601 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.066) 0:02:09.020 ********* 2020-04-28T12:51:30.814 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:48:02 UTC", "ActiveEnterTimestampMonotonic": "14168506", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target basic.target tmp.mount sntp.service ntpd.service -.mount system.slice systemd-tmpfiles-setup.service ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:48:01 UTC", "AssertTimestampMonotonic": "13020539", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:48:01 UTC", "ConditionTimestampMonotonic": "13020513", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.servic 2020-04-28T12:51:30.816 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2416", "ExecMainStartTimestamp": "Tue 2020-04-28 12:48:02 UTC", "ExecMainStartTimestampMonotonic": "14133681", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:48:01 UTC", "InactiveExitTimestampMonotonic": "13063615", "InvocationID": "84969b441016483fb6510383fc9e553d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infini 2020-04-28T12:51:30.817 INFO:teuthology.task.ansible.out:ty", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2416", "MemoryAccounting": "yes", "MemoryCurrent": "2670592", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits" 2020-04-28T12:51:30.819 INFO:teuthology.task.ansible.out:: "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:48:02 UTC", "StateChangeTimestampMonotonic": "14168506", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:48:02 UTC", "WatchdogTimestampMonotonic": "14133695", "WatchdogUSec": "0"}} 2020-04-28T12:51:30.871 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.269) 0:02:09.290 ********* 2020-04-28T12:51:30.897 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:30.899 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:51:30.964 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:30 +0000 (0:00:00.092) 0:02:09.383 ********* 2020-04-28T12:51:31.001 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:31.002 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:51:31.041 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.077) 0:02:09.460 ********* 2020-04-28T12:51:31.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:51:31.080 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.118 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.076) 0:02:09.537 ********* 2020-04-28T12:51:31.124 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-28T12:51:31.125 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:51:31.168 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.050) 0:02:09.587 ********* 2020-04-28T12:51:31.174 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:51:31.176 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.047) 0:02:09.634 ********* 2020-04-28T12:51:31.252 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:51:31.254 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.297 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.079) 0:02:09.714 ********* 2020-04-28T12:51:31.480 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:51:31.483 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:48:42 UTC", "ActiveEnterTimestampMonotonic": "14859383", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target basic.target systemd-journald.socket system.slice ntpdate.service ntpd.service systemd-tmpfiles-setup.service sntp.service tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:48:41 UTC", "AssertTimestampMonotonic": "13691696", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:48:41 UTC", "ConditionTimestampMonotonic": "13691673", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:51:31.484 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2420", "ExecMainStartTimestamp": "Tue 2020-04-28 12:48:42 UTC", "ExecMainStartTimestampMonotonic": "14810062", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:48:41 UTC", "InactiveExitTimestampMonotonic": "13700598", "InvocationID": "a1b330853acf4d6eb0e7a5655e0e1a39", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:51:31.486 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2420", "MemoryAccounting": "yes", "MemoryCurrent": "2981888", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:51:31.487 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:48:42 UTC", "StateChangeTimestampMonotonic": "14859383", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:48:42 UTC", "WatchdogTimestampMonotonic": "14810076", "WatchdogUSec": "0"}} 2020-04-28T12:51:31.523 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.227) 0:02:09.942 ********* 2020-04-28T12:51:31.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-28T12:51:31.530 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:51:31.571 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.048) 0:02:09.990 ********* 2020-04-28T12:51:31.577 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:31.579 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:51:31.618 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.046) 0:02:10.036 ********* 2020-04-28T12:51:31.655 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:31.656 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:51:31.707 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.089) 0:02:10.126 ********* 2020-04-28T12:51:31.736 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:51:31.737 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.779 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.071) 0:02:10.197 ********* 2020-04-28T12:51:31.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:51:31.818 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.868 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.087) 0:02:10.285 ********* 2020-04-28T12:51:31.905 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:51:31.907 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:31.949 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:31 +0000 (0:00:00.082) 0:02:10.368 ********* 2020-04-28T12:51:32.073 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:51:32.074 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:51:32.114 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:32 +0000 (0:00:00.164) 0:02:10.533 ********* 2020-04-28T12:51:32.154 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-28T12:51:32.158 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:51:32.202 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:32 +0000 (0:00:00.088) 0:02:10.621 ********* 2020-04-28T12:51:32.204 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:32.703 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:51:32.704 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:51:32.741 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:32 +0000 (0:00:00.538) 0:02:11.160 ********* 2020-04-28T12:51:33.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:51:33.522 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:51:33.559 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.818) 0:02:11.978 ********* 2020-04-28T12:51:33.587 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:33.625 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.065) 0:02:12.044 ********* 2020-04-28T12:51:33.662 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:51:33.664 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:51:33.702 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.076) 0:02:12.121 ********* 2020-04-28T12:51:33.782 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:51:33.783 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:51:33.826 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.123) 0:02:12.244 ********* 2020-04-28T12:51:33.853 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-28T12:51:33.854 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:33.893 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.067) 0:02:12.312 ********* 2020-04-28T12:51:33.900 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:51:33.901 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:51:33.942 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.049) 0:02:12.361 ********* 2020-04-28T12:51:33.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:51:33.950 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:51:33.992 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:33 +0000 (0:00:00.049) 0:02:12.411 ********* 2020-04-28T12:51:34.002 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-28T12:51:34.003 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.050 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.055) 0:02:12.466 ********* 2020-04-28T12:51:34.084 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-28T12:51:34.087 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:51:34.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.074) 0:02:12.541 ********* 2020-04-28T12:51:34.158 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:51:34.160 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.203 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.081) 0:02:12.622 ********* 2020-04-28T12:51:34.209 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:51:34.210 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:51:34.249 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.045) 0:02:12.668 ********* 2020-04-28T12:51:34.281 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.064) 0:02:12.733 ********* 2020-04-28T12:51:34.345 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-28T12:51:34.347 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:51:34.385 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.071) 0:02:12.804 ********* 2020-04-28T12:51:34.401 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-28T12:51:34.403 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:51:34.440 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.054) 0:02:12.859 ********* 2020-04-28T12:51:34.446 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:51:34.446 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.490 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.050) 0:02:12.909 ********* 2020-04-28T12:51:34.638 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:34.639 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:51:34.640 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:34.642 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:51:34.698 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.207) 0:02:13.117 ********* 2020-04-28T12:51:34.699 INFO:teuthology.task.ansible.out: 2020-04-28T12:51:34.707 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:51:34.751 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.053) 0:02:13.170 ********* 2020-04-28T12:51:34.757 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-28T12:51:34.758 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.795 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.044) 0:02:13.214 ********* 2020-04-28T12:51:34.836 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi176.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.851 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.857 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.857 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.858 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.895 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.099) 0:02:13.314 ********* 2020-04-28T12:51:34.934 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi176.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.945 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.945 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:34.947 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:51:34.985 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:34 +0000 (0:00:00.089) 0:02:13.403 ********* 2020-04-28T12:51:34.990 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:51:34.992 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi176.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.033 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:13.452 ********* 2020-04-28T12:51:35.039 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.050) 0:02:13.503 ********* 2020-04-28T12:51:35.091 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:35.092 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.143 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.059) 0:02:13.562 ********* 2020-04-28T12:51:35.152 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi084.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.191 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:13.610 ********* 2020-04-28T12:51:35.197 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:51:35.198 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:13.658 ********* 2020-04-28T12:51:35.245 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:51:35.247 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.248 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.262 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:51:35.263 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.300 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.060) 0:02:13.718 ********* 2020-04-28T12:51:35.338 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.037) 0:02:13.757 ********* 2020-04-28T12:51:35.343 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:51:35.345 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.386 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:13.805 ********* 2020-04-28T12:51:35.392 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:51:35.393 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.432 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.046) 0:02:13.851 ********* 2020-04-28T12:51:35.438 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:51:35.438 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.478 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.045) 0:02:13.897 ********* 2020-04-28T12:51:35.490 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.528 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.050) 0:02:13.947 ********* 2020-04-28T12:51:35.534 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:51:35.538 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.578 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.050) 0:02:13.997 ********* 2020-04-28T12:51:35.587 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.638 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.059) 0:02:14.057 ********* 2020-04-28T12:51:35.645 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:51:35.645 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.691 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.052) 0:02:14.109 ********* 2020-04-28T12:51:35.698 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.741 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:14.158 ********* 2020-04-28T12:51:35.745 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:51:35.746 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.788 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.048) 0:02:14.207 ********* 2020-04-28T12:51:35.795 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:51:35.796 INFO:teuthology.task.ansible.out:skipping: [smithi176.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.833 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.044) 0:02:14.252 ********* 2020-04-28T12:51:35.840 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:51:35.841 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.883 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.050) 0:02:14.302 ********* 2020-04-28T12:51:35.930 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:51:35.931 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:35.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:35 +0000 (0:00:00.101) 0:02:14.403 ********* 2020-04-28T12:51:36.011 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:51:36.012 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:51:36.051 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:36 +0000 (0:00:00.066) 0:02:14.470 ********* 2020-04-28T12:51:36.078 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:51:36.078 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004898", "end": "2020-04-28 12:51:36.036279", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:51:36.031381", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.274 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003121", "end": "2020-04-28 12:51:36.227399", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:51:36.224278", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi084.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004912", "end": "2020-04-28 12:51:36.238356", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:51:36.233444", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.450 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002744", "end": "2020-04-28 12:51:36.416939", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:51:36.414195", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.472 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003129", "end": "2020-04-28 12:51:36.428002", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:51:36.424873", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.649 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002828", "end": "2020-04-28 12:51:36.616620", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:51:36.613792", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.651 INFO:teuthology.task.ansible.out:ok: [smithi176.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015977", "end": "2020-04-28 12:51:36.619488", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:51:36.603511", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.714 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:36 +0000 (0:00:00.662) 0:02:15.133 ********* 2020-04-28T12:51:36.743 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:51:36.790 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:36 +0000 (0:00:00.072) 0:02:15.206 ********* 2020-04-28T12:51:36.847 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:51:36.848 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019469", "end": "2020-04-28 12:51:36.815180", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:51:36.795711", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:51:36.891 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:36 +0000 (0:00:00.104) 0:02:15.310 ********* 2020-04-28T12:51:36.918 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:51:36.971 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:51:36 +0000 (0:00:00.080) 0:02:15.390 ********* 2020-04-28T12:51:36.988 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-28T12:51:36.989 INFO:teuthology.task.ansible.out:changed: [smithi176.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:51:37.166 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:51:37.293 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-04-28T12:51:37.294 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-28T12:51:37.297 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-04-28T12:51:37.298 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-28T12:51:37.300 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-04-28T12:51:37.301 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi084.front.sepia.ceph.com : ok=113 changed=34 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi176.front.sepia.ceph.com : ok=113 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Tuesday 28 April 2020 12:51:37 +0000 (0:00:00.329) 0:02:15.719 ********* =============================================================================== 2020-04-28T12:51:37.303 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.43s 2020-04-28T12:51:37.305 INFO:teuthology.task.ansible.out:common : nrpe - Load SELinux policy package ---------------------------- 16.27s testnode : Zap all non-root disks --------------------------------------- 7.63s testnode : Install packages --------------------------------------------- 7.57s testnode : Base group workaround for BZ1782899 -------------------------- 5.02s testnode : Ensure ceph dependency packages are not present. ------------- 3.14s Gathering Facts --------------------------------------------------------- 2.59s testnode : Ensure ceph packages are not present. ------------------------ 2.15s testnode : Create logical volume(s) ------------------------------------- 2.05s testnode : Rebuild rpmdb ------------------------------------------------ 1.79s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.74s testnode : Configure local mirrorlists ---------------------------------- 1.60s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.46s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.42s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.35s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.29s common : Install Kerberos Packages (RedHat) ----------------------------- 1.11s ansible-managed : Add authorized keys for the ansible user. ------------- 1.09s testnode : Set the system's hostname ------------------------------------ 0.99s testnode : Make sure rpm dependencies are installed --------------------- 0.90s 2020-04-28T12:51:37.607 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi176.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com')] 2020-04-28T12:51:37.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:51:37.610 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi176.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:51:37.681 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:37.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:51:37.769 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:51:37.836 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:37.922 INFO:teuthology.run_tasks:Running task clock... 2020-04-28T12:51:37.935 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-28T12:51:37.935 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:37.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:51:37.950 INFO:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:51:38.057 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:51:38.057 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:51:38.108 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2020-04-28T12:51:38.122 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2020-04-28T12:51:38.124 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:51:38.142 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:51:38.207 INFO:teuthology.orchestra.run.smithi176.stderr:bash: ntpq: command not found 2020-04-28T12:51:38.224 INFO:teuthology.orchestra.run.smithi176.stdout:210 Number of sources = 4 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.225 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.226 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:38.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:51:38.240 INFO:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:51:38.347 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:51:38.347 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:51:38.384 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2020-04-28T12:51:38.399 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2020-04-28T12:51:38.418 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:51:38.421 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:51:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2020-04-28T12:51:38.516 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.517 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:51:38.518 INFO:teuthology.run_tasks:Running task install... 2020-04-28T12:51:38.527 DEBUG:teuthology.task.install:project ceph 2020-04-28T12:51:38.527 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}} 2020-04-28T12:51:38.527 DEBUG:teuthology.task.install:config {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:51:38.527 INFO:teuthology.task.install:Using flavor: basic 2020-04-28T12:51:38.533 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-28T12:51:38.534 INFO:teuthology.task.install:extra packages: [] 2020-04-28T12:51:38.534 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:38.548 INFO:teuthology.orchestra.run.smithi176:> sudo lsb_release -is 2020-04-28T12:51:38.623 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS 2020-04-28T12:51:38.624 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:51:38.625 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:38.625 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:51:38.625 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:38.640 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-28T12:51:38.678 INFO:teuthology.orchestra.run.smithi176:> sudo lsb_release -is 2020-04-28T12:51:38.715 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-28T12:51:38.716 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:51:38.717 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:51:38.717 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:38.753 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS 2020-04-28T12:51:38.754 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:51:38.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:51:38.771 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-28T12:51:38.846 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-28T12:51:38.847 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:51:38.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:51:39.020 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:51:39.020 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:51:39.085 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:51:39.085 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:51:39.200 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:51:39.201 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:39.215 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:51:39.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:51:39.263 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:39.277 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:51:39.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:51:39.301 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:39.354 INFO:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:51:39.365 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:51:39.366 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:39.419 INFO:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:51:39.423 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:39.476 INFO:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:51:39.489 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:39.543 INFO:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:51:39.557 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:39.611 INFO:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:51:39.624 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:39.678 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2020-04-28T12:51:39.679 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:39.680 INFO:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:51:39.732 INFO:teuthology.orchestra.run.smithi176:> sudo yum clean all 2020-04-28T12:51:39.746 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2020-04-28T12:51:39.747 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:39.800 INFO:teuthology.orchestra.run.smithi084:> sudo yum clean all 2020-04-28T12:51:40.011 INFO:teuthology.orchestra.run.smithi176.stdout:50 files removed 2020-04-28T12:51:40.039 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:51:40.052 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw 2020-04-28T12:51:40.077 INFO:teuthology.orchestra.run.smithi084.stdout:50 files removed 2020-04-28T12:51:40.106 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:51:40.119 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw 2020-04-28T12:51:40.815 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-28T12:51:40.876 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 182 kB/s | 69 kB 00:00 2020-04-28T12:51:41.151 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:51:41.211 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:51:41.478 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:51:41.537 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:51:41.649 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - AppStream 46 MB/s | 7.0 MB 00:00 2020-04-28T12:51:41.715 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - AppStream 44 MB/s | 7.0 MB 00:00 2020-04-28T12:51:42.828 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:51:42.895 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:51:43.255 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-04-28T12:51:43.311 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-04-28T12:51:43.467 INFO:teuthology.orchestra.run.smithi176.stdout:Copr repo for ceph-el8 owned by ktdreyer 279 kB/s | 47 kB 00:00 2020-04-28T12:51:43.469 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for ceph-el8 owned by ktdreyer 413 kB/s | 47 kB 00:00 2020-04-28T12:51:43.747 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 29 MB/s | 6.4 MB 00:00 2020-04-28T12:51:43.785 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 24 MB/s | 6.4 MB 00:00 2020-04-28T12:51:45.060 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 4.3 MB/s | 20 kB 00:00 2020-04-28T12:51:45.125 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 4.3 MB/s | 20 kB 00:00 2020-04-28T12:51:46.032 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:51:46.035 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:51:46.036 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:51:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:51:46.038 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:Install 21 Packages 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2020-04-28T12:51:46.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:51:46.040 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 51 M 2020-04-28T12:51:46.040 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:51:46.105 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:51:46.108 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:51:46.109 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:51:46.110 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:51:46.111 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:51:46.112 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:51:46.113 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:51:46.113 INFO:teuthology.orchestra.run.smithi176.stdout:Install 21 Packages 2020-04-28T12:51:46.113 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 2 Packages 2020-04-28T12:51:46.113 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:51:46.113 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 51 M 2020-04-28T12:51:46.114 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:51:48.545 INFO:teuthology.orchestra.run.smithi084.stdout:(1/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 3.9 MB/s | 9.8 MB 00:02 2020-04-28T12:51:48.612 INFO:teuthology.orchestra.run.smithi084.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 375 kB/s | 25 kB 00:00 2020-04-28T12:51:48.760 INFO:teuthology.orchestra.run.smithi084.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 3.3 MB/s | 508 kB 00:00 2020-04-28T12:51:48.905 INFO:teuthology.orchestra.run.smithi084.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 2.5 MB/s | 377 kB 00:00 2020-04-28T12:51:49.115 INFO:teuthology.orchestra.run.smithi084.stdout:(5/23): ceph-common-15.2.1-136.ga8c125c7d7.el8. 6.7 MB/s | 21 MB 00:03 2020-04-28T12:51:49.174 INFO:teuthology.orchestra.run.smithi084.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 675 kB/s | 40 kB 00:00 2020-04-28T12:51:49.235 INFO:teuthology.orchestra.run.smithi084.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.0 MB/s | 64 kB 00:00 2020-04-28T12:51:49.300 INFO:teuthology.orchestra.run.smithi084.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 2.4 MB/s | 162 kB 00:00 2020-04-28T12:51:49.372 INFO:teuthology.orchestra.run.smithi084.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 4.7 MB/s | 352 kB 00:00 2020-04-28T12:51:49.444 INFO:teuthology.orchestra.run.smithi084.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 4.2 MB/s | 309 kB 00:00 2020-04-28T12:51:49.509 INFO:teuthology.orchestra.run.smithi084.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 1.7 MB/s | 113 kB 00:00 2020-04-28T12:51:49.543 INFO:teuthology.orchestra.run.smithi084.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2020-04-28T12:51:49.547 INFO:teuthology.orchestra.run.smithi084.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 64 MB/s | 259 kB 00:00 2020-04-28T12:51:49.548 INFO:teuthology.orchestra.run.smithi084.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 34 MB/s | 44 kB 00:00 2020-04-28T12:51:49.550 INFO:teuthology.orchestra.run.smithi084.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 35 MB/s | 47 kB 00:00 2020-04-28T12:51:49.665 INFO:teuthology.orchestra.run.smithi084.stdout:(16/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-28T12:51:49.685 INFO:teuthology.orchestra.run.smithi084.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 8.8 MB/s | 181 kB 00:00 2020-04-28T12:51:49.704 INFO:teuthology.orchestra.run.smithi084.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-28T12:51:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-28T12:51:49.827 INFO:teuthology.orchestra.run.smithi176.stdout:(1/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x8 1.5 MB/s | 5.5 MB 00:03 2020-04-28T12:51:49.904 INFO:teuthology.orchestra.run.smithi176.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 323 kB/s | 25 kB 00:00 2020-04-28T12:51:50.234 INFO:teuthology.orchestra.run.smithi176.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 1.5 MB/s | 508 kB 00:00 2020-04-28T12:51:50.290 INFO:teuthology.orchestra.run.smithi084.stdout:(20/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 6.3 MB/s | 3.6 MB 00:00 2020-04-28T12:51:50.345 INFO:teuthology.orchestra.run.smithi084.stdout:(21/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86 4.3 MB/s | 6.2 MB 00:01 2020-04-28T12:51:50.472 INFO:teuthology.orchestra.run.smithi176.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 1.6 MB/s | 377 kB 00:00 2020-04-28T12:51:50.584 INFO:teuthology.orchestra.run.smithi084.stdout:(22/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 6.5 MB/s | 1.9 MB 00:00 2020-04-28T12:51:51.686 INFO:teuthology.orchestra.run.smithi176.stdout:(5/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 1.8 MB/s | 9.8 MB 00:05 2020-04-28T12:51:51.745 INFO:teuthology.orchestra.run.smithi176.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 680 kB/s | 40 kB 00:00 2020-04-28T12:51:51.805 INFO:teuthology.orchestra.run.smithi176.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.0 MB/s | 64 kB 00:00 2020-04-28T12:51:51.899 INFO:teuthology.orchestra.run.smithi176.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 1.7 MB/s | 162 kB 00:00 2020-04-28T12:51:51.926 INFO:teuthology.orchestra.run.smithi084.stdout:(23/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x 953 kB/s | 5.5 MB 00:05 2020-04-28T12:51:51.929 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:51:51.929 INFO:teuthology.orchestra.run.smithi084.stdout:Total 8.6 MB/s | 51 MB 00:05 2020-04-28T12:51:51.935 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:51:51.978 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:51:51.979 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:51:52.008 INFO:teuthology.orchestra.run.smithi176.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 3.2 MB/s | 352 kB 00:00 2020-04-28T12:51:52.116 INFO:teuthology.orchestra.run.smithi176.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 2.8 MB/s | 309 kB 00:00 2020-04-28T12:51:52.156 INFO:teuthology.orchestra.run.smithi176.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 2.8 MB/s | 113 kB 00:00 2020-04-28T12:51:52.190 INFO:teuthology.orchestra.run.smithi176.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2020-04-28T12:51:52.194 INFO:teuthology.orchestra.run.smithi176.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 68 MB/s | 259 kB 00:00 2020-04-28T12:51:52.196 INFO:teuthology.orchestra.run.smithi176.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 35 MB/s | 44 kB 00:00 2020-04-28T12:51:52.197 INFO:teuthology.orchestra.run.smithi176.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 36 MB/s | 47 kB 00:00 2020-04-28T12:51:52.292 INFO:teuthology.orchestra.run.smithi176.stdout:(16/23): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-28T12:51:52.308 INFO:teuthology.orchestra.run.smithi176.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 11 MB/s | 181 kB 00:00 2020-04-28T12:51:52.325 INFO:teuthology.orchestra.run.smithi176.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-04-28T12:51:52.328 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:51:52.329 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:51:52.341 INFO:teuthology.orchestra.run.smithi176.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 4.5 MB/s | 75 kB 00:00 2020-04-28T12:51:52.604 INFO:teuthology.orchestra.run.smithi176.stdout:(20/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86 2.9 MB/s | 6.2 MB 00:02 2020-04-28T12:51:53.102 INFO:teuthology.orchestra.run.smithi176.stdout:(21/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 3.8 MB/s | 1.9 MB 00:00 2020-04-28T12:51:53.257 INFO:teuthology.orchestra.run.smithi176.stdout:(22/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 3.9 MB/s | 3.6 MB 00:00 2020-04-28T12:51:53.308 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:51:53.519 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:51:53.730 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:51:54.133 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:51:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:51:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:51:54.627 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:51:54.644 INFO:teuthology.orchestra.run.smithi176.stdout:(23/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 2.4 MB/s | 21 MB 00:08 2020-04-28T12:51:54.647 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:51:54.648 INFO:teuthology.orchestra.run.smithi176.stdout:Total 6.0 MB/s | 51 MB 00:08 2020-04-28T12:51:54.654 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:51:54.700 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:51:54.700 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:51:54.779 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:51:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:51:55.055 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:51:55.055 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:51:55.238 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:51:55.304 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:51:55.478 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:51:55.638 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:51:56.079 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:51:56.238 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:51:56.257 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:51:56.379 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:51:56.421 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:51:56.444 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:51:56.617 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:51:56.738 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:51:56.799 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:51:56.924 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:51:56.963 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:51:57.052 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:51:57.158 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:51:57.255 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:51:57.354 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:51:57.429 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:51:57.546 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:51:57.615 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:51:57.665 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:51:57.791 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:51:57.879 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:51:57.928 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:51:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:51:58.137 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:51:58.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:51:58.271 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:51:58.396 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:51:58.886 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:51:59.029 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:51:59.137 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:51:59.276 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:51:59.422 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:51:59.566 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:51:59.766 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:51:59.935 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:52:00.104 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:52:00.178 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:52:00.458 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:52:00.678 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:52:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:52:01.029 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:52:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:52:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:52:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:04.854 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:05.535 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:52:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:52:05.948 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:52:06.070 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:19.415 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:19.415 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2020-04-28T12:52:19.415 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2020-04-28T12:52:19.416 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2020-04-28T12:52:19.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:20.491 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:52:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:52:20.553 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:52:20.776 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:52:20.776 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:52:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:52:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:52:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:52:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:52:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:52:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:52:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:22.248 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:52:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:52:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:52:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:22.252 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /dev 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /run 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2020-04-28T12:52:22.264 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2020-04-28T12:52:22.265 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2020-04-28T12:52:22.265 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /dev 2020-04-28T12:52:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:22.597 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:22.615 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-test 2020-04-28T12:52:23.065 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:38 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:23.367 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:52:23.442 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:23.443 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:52:23.444 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:23.445 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2020-04-28T12:52:23.446 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:23.446 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:52:23.447 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:52:23.447 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 43 M 2020-04-28T12:52:23.447 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 185 M 2020-04-28T12:52:23.447 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:52:23.479 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.9 MB/s | 161 kB 00:00 2020-04-28T12:52:23.484 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.9 MB/s | 188 kB 00:00 2020-04-28T12:52:23.490 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 27 MB/s | 298 kB 00:00 2020-04-28T12:52:23.494 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 49 MB/s | 249 kB 00:00 2020-04-28T12:52:23.552 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:52:23.652 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:52:23.652 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:24.355 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:52:24.356 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:52:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:52:24.358 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:52:24.358 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:52:24.358 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:52:24.358 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:52:24.359 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:52:24.359 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:52:24.359 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:52:24.359 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:52:24.360 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:52:24.360 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:52:24.360 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:52:25.190 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:52:25.190 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:25.190 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2020-04-28T12:52:25.190 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.190 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.191 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.192 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:52:25.193 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:52:25.194 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:52:25.194 INFO:teuthology.orchestra.run.smithi176.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:52:25.194 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:52:25.194 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:52:25.195 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:25.195 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 20 MB/s | 42 MB 00:02 2020-04-28T12:52:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:Total 20 MB/s | 43 MB 00:02 2020-04-28T12:52:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:52:25.555 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:25.569 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-test 2020-04-28T12:52:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:52:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:52:26.020 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:41 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:26.119 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:52:26.120 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:52:26.368 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:26.369 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:52:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:52:26.371 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:26.372 INFO:teuthology.orchestra.run.smithi176.stdout:Install 6 Packages 2020-04-28T12:52:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:26.372 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 43 M 2020-04-28T12:52:26.372 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 185 M 2020-04-28T12:52:26.373 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:52:26.407 INFO:teuthology.orchestra.run.smithi176.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.6 MB/s | 161 kB 00:00 2020-04-28T12:52:26.409 INFO:teuthology.orchestra.run.smithi176.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.9 MB/s | 188 kB 00:00 2020-04-28T12:52:26.416 INFO:teuthology.orchestra.run.smithi176.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 31 MB/s | 298 kB 00:00 2020-04-28T12:52:26.418 INFO:teuthology.orchestra.run.smithi176.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 62 MB/s | 249 kB 00:00 2020-04-28T12:52:26.492 INFO:teuthology.orchestra.run.smithi176.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 915 kB/s | 69 kB 00:00 2020-04-28T12:52:26.887 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:52:27.116 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:52:27.296 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:52:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:52:27.639 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:52:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:52:28.472 INFO:teuthology.orchestra.run.smithi176.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 20 MB/s | 42 MB 00:02 2020-04-28T12:52:28.475 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:28.476 INFO:teuthology.orchestra.run.smithi176.stdout:Total 20 MB/s | 43 MB 00:02 2020-04-28T12:52:28.481 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:52:28.503 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:52:28.503 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:52:28.764 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:52:28.764 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:52:29.271 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:52:29.467 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:52:29.652 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:52:29.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:52:30.040 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:52:30.106 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:52:32.070 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:52:33.002 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:52:33.203 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:52:33.203 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:52:33.203 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:52:33.203 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:52:33.203 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:52:33.204 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:52:33.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:52:33.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:33.536 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:52:33.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:52:33.536 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:52:33.536 INFO:teuthology.orchestra.run.smithi084.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:52:33.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:33.537 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:33.754 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:33.768 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph 2020-04-28T12:52:34.146 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:52:34.220 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:49 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:34.370 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:52:34.569 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:52:34.569 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:52:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:52:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:52:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:52:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:52:34.638 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout: Package ArchVersion Repository Size 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:52:34.642 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:52:34.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:52:34.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:52:34.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:52:34.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:52:34.647 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout:Install 32 Packages 2020-04-28T12:52:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:34.649 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 29 M 2020-04-28T12:52:34.649 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 103 M 2020-04-28T12:52:34.649 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:52:34.811 INFO:teuthology.orchestra.run.smithi084.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 39 kB/s | 6.4 kB 00:00 2020-04-28T12:52:34.889 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:52:34.889 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:34.889 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:52:34.890 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:52:34.890 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:52:34.890 INFO:teuthology.orchestra.run.smithi176.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:52:34.890 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:34.890 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:35.143 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:35.147 INFO:teuthology.orchestra.run.smithi084.stdout:(2/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 2.8 MB/s | 1.4 MB 00:00 2020-04-28T12:52:35.156 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph 2020-04-28T12:52:35.194 INFO:teuthology.orchestra.run.smithi084.stdout:(3/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 3.7 MB/s | 2.0 MB 00:00 2020-04-28T12:52:35.256 INFO:teuthology.orchestra.run.smithi084.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 2.6 MB/s | 164 kB 00:00 2020-04-28T12:52:35.288 INFO:teuthology.orchestra.run.smithi084.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2020-04-28T12:52:35.307 INFO:teuthology.orchestra.run.smithi084.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 79 MB/s | 1.5 MB 00:00 2020-04-28T12:52:35.310 INFO:teuthology.orchestra.run.smithi084.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 58 MB/s | 157 kB 00:00 2020-04-28T12:52:35.312 INFO:teuthology.orchestra.run.smithi084.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 29 MB/s | 39 kB 00:00 2020-04-28T12:52:35.313 INFO:teuthology.orchestra.run.smithi084.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2020-04-28T12:52:35.314 INFO:teuthology.orchestra.run.smithi084.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 24 MB/s | 27 kB 00:00 2020-04-28T12:52:35.320 INFO:teuthology.orchestra.run.smithi084.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 75 MB/s | 457 kB 00:00 2020-04-28T12:52:35.442 INFO:teuthology.orchestra.run.smithi084.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 1.2 MB/s | 145 kB 00:00 2020-04-28T12:52:35.463 INFO:teuthology.orchestra.run.smithi084.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 18 MB/s | 385 kB 00:00 2020-04-28T12:52:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:52:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.1 MB/s | 18 kB 00:00 2020-04-28T12:52:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.5 MB/s | 49 kB 00:00 2020-04-28T12:52:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 6.7 MB/s | 59 kB 00:00 2020-04-28T12:52:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 21 MB/s | 283 kB 00:00 2020-04-28T12:52:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-28T12:52:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:52:35.536 INFO:teuthology.orchestra.run.smithi084.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 2.8 MB/s | 24 kB 00:00 2020-04-28T12:52:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.6 MB/s | 30 kB 00:00 2020-04-28T12:52:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 2.5 MB/s | 27 kB 00:00 2020-04-28T12:52:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.8 MB/s | 23 kB 00:00 2020-04-28T12:52:35.596 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:50 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 555 kB/s | 44 kB 00:00 2020-04-28T12:52:35.688 INFO:teuthology.orchestra.run.smithi084.stdout:(26/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.9 MB/s | 185 kB 00:00 2020-04-28T12:52:35.704 INFO:teuthology.orchestra.run.smithi084.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.5 MB/s | 40 kB 00:00 2020-04-28T12:52:35.736 INFO:teuthology.orchestra.run.smithi084.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2020-04-28T12:52:35.753 INFO:teuthology.orchestra.run.smithi084.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 14 MB/s | 251 kB 00:00 2020-04-28T12:52:35.769 INFO:teuthology.orchestra.run.smithi084.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 5.2 MB/s | 85 kB 00:00 2020-04-28T12:52:35.963 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:35.966 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:35.966 INFO:teuthology.orchestra.run.smithi176.stdout: Package ArchVersion Repository Size 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:52:35.967 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:52:35.968 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:52:35.969 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:52:35.970 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:52:35.971 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:35.972 INFO:teuthology.orchestra.run.smithi176.stdout:Install 32 Packages 2020-04-28T12:52:35.973 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:35.973 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 29 M 2020-04-28T12:52:35.973 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 103 M 2020-04-28T12:52:35.974 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:52:36.293 INFO:teuthology.orchestra.run.smithi176.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2020-04-28T12:52:36.308 INFO:teuthology.orchestra.run.smithi084.stdout:(31/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 2.9 MB/s | 4.4 MB 00:01 2020-04-28T12:52:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 11 MB/s | 17 MB 00:01 2020-04-28T12:52:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:Total 15 MB/s | 29 MB 00:01 2020-04-28T12:52:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:52:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:52:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:52:36.761 INFO:teuthology.orchestra.run.smithi176.stdout:(2/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 1.8 MB/s | 1.4 MB 00:00 2020-04-28T12:52:36.863 INFO:teuthology.orchestra.run.smithi176.stdout:(3/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 2.3 MB/s | 2.0 MB 00:00 2020-04-28T12:52:36.974 INFO:teuthology.orchestra.run.smithi176.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 1.4 MB/s | 164 kB 00:00 2020-04-28T12:52:37.022 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:52:37.022 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:52:37.052 INFO:teuthology.orchestra.run.smithi176.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 2.7 MB/s | 214 kB 00:00 2020-04-28T12:52:37.104 INFO:teuthology.orchestra.run.smithi176.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 29 MB/s | 1.5 MB 00:00 2020-04-28T12:52:37.129 INFO:teuthology.orchestra.run.smithi176.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2020-04-28T12:52:37.169 INFO:teuthology.orchestra.run.smithi176.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 974 kB/s | 39 kB 00:00 2020-04-28T12:52:37.172 INFO:teuthology.orchestra.run.smithi176.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 20 MB/s | 54 kB 00:00 2020-04-28T12:52:37.174 INFO:teuthology.orchestra.run.smithi176.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 10 MB/s | 27 kB 00:00 2020-04-28T12:52:37.184 INFO:teuthology.orchestra.run.smithi176.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 47 MB/s | 457 kB 00:00 2020-04-28T12:52:37.246 INFO:teuthology.orchestra.run.smithi176.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.3 MB/s | 145 kB 00:00 2020-04-28T12:52:37.267 INFO:teuthology.orchestra.run.smithi176.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 18 MB/s | 385 kB 00:00 2020-04-28T12:52:37.276 INFO:teuthology.orchestra.run.smithi176.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:52:37.284 INFO:teuthology.orchestra.run.smithi176.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.2 MB/s | 18 kB 00:00 2020-04-28T12:52:37.293 INFO:teuthology.orchestra.run.smithi176.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.6 MB/s | 49 kB 00:00 2020-04-28T12:52:37.301 INFO:teuthology.orchestra.run.smithi176.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 6.8 MB/s | 59 kB 00:00 2020-04-28T12:52:37.314 INFO:teuthology.orchestra.run.smithi176.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-28T12:52:37.322 INFO:teuthology.orchestra.run.smithi176.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-28T12:52:37.331 INFO:teuthology.orchestra.run.smithi176.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:52:37.339 INFO:teuthology.orchestra.run.smithi176.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 2.9 MB/s | 24 kB 00:00 2020-04-28T12:52:37.348 INFO:teuthology.orchestra.run.smithi176.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.5 MB/s | 30 kB 00:00 2020-04-28T12:52:37.356 INFO:teuthology.orchestra.run.smithi176.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.2 MB/s | 27 kB 00:00 2020-04-28T12:52:37.365 INFO:teuthology.orchestra.run.smithi176.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.7 MB/s | 23 kB 00:00 2020-04-28T12:52:37.440 INFO:teuthology.orchestra.run.smithi176.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 580 kB/s | 44 kB 00:00 2020-04-28T12:52:37.505 INFO:teuthology.orchestra.run.smithi176.stdout:(26/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 3.6 MB/s | 4.4 MB 00:01 2020-04-28T12:52:37.506 INFO:teuthology.orchestra.run.smithi176.stdout:(27/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.8 MB/s | 185 kB 00:00 2020-04-28T12:52:37.544 INFO:teuthology.orchestra.run.smithi176.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 6.2 MB/s | 241 kB 00:00 2020-04-28T12:52:37.551 INFO:teuthology.orchestra.run.smithi176.stdout:(29/32): python3-cssselect-0.9.2-10.el8.noarch. 865 kB/s | 40 kB 00:00 2020-04-28T12:52:37.564 INFO:teuthology.orchestra.run.smithi176.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 12 MB/s | 251 kB 00:00 2020-04-28T12:52:37.597 INFO:teuthology.orchestra.run.smithi176.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.8 MB/s | 85 kB 00:00 2020-04-28T12:52:38.027 INFO:teuthology.orchestra.run.smithi176.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 13 MB/s | 17 MB 00:01 2020-04-28T12:52:38.030 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:38.031 INFO:teuthology.orchestra.run.smithi176.stdout:Total 14 MB/s | 29 MB 00:02 2020-04-28T12:52:38.048 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:52:38.086 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:52:38.086 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:52:38.175 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:52:38.411 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:52:38.412 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:52:38.414 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:52:38.607 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:52:38.822 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:52:38.962 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:52:39.161 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:52:39.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:52:39.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:52:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:52:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:52:39.789 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:52:39.825 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:52:39.950 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:52:40.051 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:52:40.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:52:40.274 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:52:40.284 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:52:40.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:52:40.539 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:52:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:52:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:52:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:52:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:52:40.962 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:52:41.135 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:52:41.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:52:41.281 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:52:41.433 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:52:41.530 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:52:41.561 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:52:41.766 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:52:41.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:52:42.025 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:52:42.056 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:52:42.222 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:52:42.274 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:52:42.383 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:52:42.489 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:52:42.628 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:52:42.708 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:52:42.823 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:52:43.055 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:52:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:52:43.380 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:52:43.392 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:52:43.578 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:52:43.716 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:52:43.758 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:52:43.969 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:52:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:52:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:52:44.233 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:52:44.392 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:52:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:52:44.989 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:52:45.310 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:52:45.629 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:52:45.659 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:52:45.796 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:52:45.835 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:52:46.220 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:52:46.393 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:52:46.586 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:52:46.718 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:52:46.737 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:52:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:52:47.194 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:52:47.194 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:52:47.194 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:52:47.195 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:52:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:52:47.197 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:52:47.198 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:52:47.199 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:52:47.219 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:52:47.421 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:52:47.808 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:52:47.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:52:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:52:47.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:52:47.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:52:47.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:52:47.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:52:47.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:47.941 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:48.038 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:52:48.220 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:48.231 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:52:48.234 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-base 2020-04-28T12:52:48.371 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:52:48.390 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:52:48.547 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:52:48.679 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:03 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:48.861 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:52:48.861 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:52:48.861 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:52:48.861 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:52:48.861 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:52:48.862 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:52:48.863 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:52:48.864 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:52:48.865 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:52:48.865 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:52:48.866 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:52:48.866 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:52:48.866 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:52:48.866 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:52:48.866 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:52:48.925 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:52:49.027 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:49.028 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:52:49.028 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:49.161 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:49.174 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install cephadm 2020-04-28T12:52:49.513 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:52:49.513 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:49.514 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:52:49.515 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:52:49.517 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:52:49.517 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:52:49.517 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:52:49.517 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:52:49.518 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:52:49.519 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:52:49.520 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:49.520 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:49.607 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:04 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:49.849 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:49.863 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-base 2020-04-28T12:52:49.968 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:49.968 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:49.968 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-28T12:52:49.968 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:52:49.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 41 k 2020-04-28T12:52:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 161 k 2020-04-28T12:52:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:52:50.192 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 183 kB/s | 41 kB 00:00 2020-04-28T12:52:50.193 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:50.193 INFO:teuthology.orchestra.run.smithi084.stdout:Total 182 kB/s | 41 kB 00:00 2020-04-28T12:52:50.195 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:52:50.202 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:52:50.203 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:52:50.204 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:52:50.205 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:52:50.244 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:52:50.311 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:05 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:50.570 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:52:50.674 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:50.675 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:52:50.676 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:50.831 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:50.845 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install cephadm 2020-04-28T12:52:51.291 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:06 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:51.658 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:51.663 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:51.663 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:51.664 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:52:51.665 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:51.665 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:52:51.665 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:51.666 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 41 k 2020-04-28T12:52:51.666 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 161 k 2020-04-28T12:52:51.666 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:52:51.888 INFO:teuthology.orchestra.run.smithi176.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 183 kB/s | 41 kB 00:00 2020-04-28T12:52:51.889 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:51.889 INFO:teuthology.orchestra.run.smithi176.stdout:Total 182 kB/s | 41 kB 00:00 2020-04-28T12:52:51.891 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:52:51.898 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:52:51.898 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:52:51.900 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:52:51.900 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:52:51.904 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:51.947 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:52:52.100 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:52.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:52.101 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:52:52.101 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:52.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:52.101 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:52.278 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:52.292 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:52:52.736 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:07 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:53.078 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:53.079 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:53.079 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2020-04-28T12:52:53.079 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:52:53.080 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:53.081 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 203 k 2020-04-28T12:52:53.081 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 743 k 2020-04-28T12:52:53.081 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:52:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:53.518 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 464 kB/s | 203 kB 00:00 2020-04-28T12:52:53.518 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:53.519 INFO:teuthology.orchestra.run.smithi084.stdout:Total 463 kB/s | 203 kB 00:00 2020-04-28T12:52:53.521 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:52:53.534 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:52:53.534 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:52:53.583 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:52:53.584 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:52:53.593 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:52:53.818 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:52:53.818 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:53.822 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:52:53.822 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:53.822 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:53.822 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:53.958 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:53.988 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:54.002 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:52:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:54.447 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:09 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:54.504 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:54.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:54.504 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:52:54.504 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:54.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:54.505 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:54.797 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:54.798 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:54.799 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 203 k 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 743 k 2020-04-28T12:52:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:52:54.812 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:54.826 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr 2020-04-28T12:52:55.268 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:10 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:55.279 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 423 kB/s | 203 kB 00:00 2020-04-28T12:52:55.280 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:55.280 INFO:teuthology.orchestra.run.smithi176.stdout:Total 422 kB/s | 203 kB 00:00 2020-04-28T12:52:55.282 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:52:55.294 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:52:55.294 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:52:55.340 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:52:55.341 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:52:55.458 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:52:55.549 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:52:55.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:55.652 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:55.653 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:52:55.654 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:52:55.787 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:52:55.800 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:52:55.955 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:56.235 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:52:56.235 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:56.235 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:52:56.235 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:52:56.236 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:56.236 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:56.236 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:11 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:56.516 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:56.531 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr 2020-04-28T12:52:56.626 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:52:56.627 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:56.627 INFO:teuthology.orchestra.run.smithi084.stdout: Package ArchVersion Repository Size 2020-04-28T12:52:56.627 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:56.627 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:52:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:52:56.629 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:56.629 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:52:56.629 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:52:56.629 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2020-04-28T12:52:56.629 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:52:56.630 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.6 M 2020-04-28T12:52:56.630 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 19 M 2020-04-28T12:52:56.630 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:52:56.790 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 55 kB/s | 8.8 kB 00:00 2020-04-28T12:52:56.819 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 119 kB/s | 22 kB 00:00 2020-04-28T12:52:56.820 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-04-28T12:52:56.865 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 722 kB/s | 34 kB 00:00 2020-04-28T12:52:56.885 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.0 MB/s | 197 kB 00:00 2020-04-28T12:52:56.976 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:11 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:57.097 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 7.1 MB/s | 3.3 MB 00:00 2020-04-28T12:52:57.101 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:57.101 INFO:teuthology.orchestra.run.smithi084.stdout:Total 7.7 MB/s | 3.6 MB 00:00 2020-04-28T12:52:57.105 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:52:57.113 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:52:57.114 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:52:57.235 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:52:57.261 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:52:57.262 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:52:57.339 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:57.340 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:52:57.340 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:52:57.472 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:52:57.486 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:52:57.501 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:52:57.688 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:52:57.922 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:12 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:52:57.924 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:52:58.143 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:52:58.255 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:52:58.297 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:52:58.298 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout: Package ArchVersion Repository Size 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:52:58.299 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:52:58.300 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:52:58.301 INFO:teuthology.orchestra.run.smithi176.stdout:Install 6 Packages 2020-04-28T12:52:58.301 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:52:58.301 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 3.6 M 2020-04-28T12:52:58.301 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 19 M 2020-04-28T12:52:58.302 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:52:58.461 INFO:teuthology.orchestra.run.smithi176.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 55 kB/s | 8.8 kB 00:00 2020-04-28T12:52:58.488 INFO:teuthology.orchestra.run.smithi176.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 120 kB/s | 22 kB 00:00 2020-04-28T12:52:58.492 INFO:teuthology.orchestra.run.smithi176.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2020-04-28T12:52:58.535 INFO:teuthology.orchestra.run.smithi176.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 758 kB/s | 34 kB 00:00 2020-04-28T12:52:58.558 INFO:teuthology.orchestra.run.smithi176.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.0 MB/s | 197 kB 00:00 2020-04-28T12:52:58.767 INFO:teuthology.orchestra.run.smithi176.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 7.2 MB/s | 3.3 MB 00:00 2020-04-28T12:52:58.770 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:52:58.771 INFO:teuthology.orchestra.run.smithi176.stdout:Total 7.7 MB/s | 3.6 MB 00:00 2020-04-28T12:52:58.775 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:52:58.783 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:52:58.784 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:52:58.930 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:52:58.930 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:52:59.199 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:52:59.300 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:52:59.417 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:52:59.670 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:52:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:52:59.992 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:53:00.571 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:53:00.784 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:53:00.785 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:53:00.785 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:53:00.785 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:53:00.785 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:53:00.785 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:53:00.980 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:53:01.023 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:53:01.024 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:53:01.025 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:53:01.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:01.025 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:01.173 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:01.186 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:53:01.285 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:53:01.496 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:53:01.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:53:01.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:53:01.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:53:01.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:53:01.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:53:01.622 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:16 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:01.759 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:53:01.759 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:01.759 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:01.759 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:01.760 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:01.880 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:01.893 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:53:01.967 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:01.968 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: Package ArchVersion Repository Size 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:53:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:01.970 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:01.971 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:01.971 INFO:teuthology.orchestra.run.smithi084.stdout:Install 8 Packages 2020-04-28T12:53:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:01.971 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 37 M 2020-04-28T12:53:01.971 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 205 M 2020-04-28T12:53:01.972 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:02.069 INFO:teuthology.orchestra.run.smithi084.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 44 MB/s | 4.3 MB 00:00 2020-04-28T12:53:02.130 INFO:teuthology.orchestra.run.smithi084.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 62 MB/s | 3.7 MB 00:00 2020-04-28T12:53:02.136 INFO:teuthology.orchestra.run.smithi084.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 37 MB/s | 225 kB 00:00 2020-04-28T12:53:02.148 INFO:teuthology.orchestra.run.smithi084.stdout:(4/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2020-04-28T12:53:02.168 INFO:teuthology.orchestra.run.smithi084.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 30 MB/s | 638 kB 00:00 2020-04-28T12:53:02.179 INFO:teuthology.orchestra.run.smithi084.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 16 MB/s | 169 kB 00:00 2020-04-28T12:53:02.329 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:17 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:02.358 INFO:teuthology.orchestra.run.smithi084.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 66 MB/s | 15 MB 00:00 2020-04-28T12:53:02.668 INFO:teuthology.orchestra.run.smithi084.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 12 MB/s | 8.6 MB 00:00 2020-04-28T12:53:02.670 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:02.670 INFO:teuthology.orchestra.run.smithi084.stdout:Total 52 MB/s | 37 MB 00:00 2020-04-28T12:53:02.681 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:02.699 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:02.699 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:02.705 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:02.706 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:02.706 INFO:teuthology.orchestra.run.smithi176.stdout: Package ArchVersion Repository Size 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:53:02.707 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:02.708 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:02.709 INFO:teuthology.orchestra.run.smithi176.stdout:Install 8 Packages 2020-04-28T12:53:02.709 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:02.709 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 37 M 2020-04-28T12:53:02.709 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 205 M 2020-04-28T12:53:02.710 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:02.820 INFO:teuthology.orchestra.run.smithi176.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 39 MB/s | 4.3 MB 00:00 2020-04-28T12:53:02.861 INFO:teuthology.orchestra.run.smithi176.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2020-04-28T12:53:02.869 INFO:teuthology.orchestra.run.smithi176.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 29 MB/s | 225 kB 00:00 2020-04-28T12:53:02.893 INFO:teuthology.orchestra.run.smithi176.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 51 MB/s | 3.7 MB 00:00 2020-04-28T12:53:02.907 INFO:teuthology.orchestra.run.smithi176.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 48 MB/s | 638 kB 00:00 2020-04-28T12:53:02.912 INFO:teuthology.orchestra.run.smithi176.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 32 MB/s | 169 kB 00:00 2020-04-28T12:53:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:03.208 INFO:teuthology.orchestra.run.smithi176.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 43 MB/s | 15 MB 00:00 2020-04-28T12:53:03.549 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:03.681 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:53:03.686 INFO:teuthology.orchestra.run.smithi176.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 8.8 MB/s | 8.6 MB 00:00 2020-04-28T12:53:03.692 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:03.692 INFO:teuthology.orchestra.run.smithi176.stdout:Total 37 MB/s | 37 MB 00:00 2020-04-28T12:53:03.704 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:03.725 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:03.725 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:03.843 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:53:04.064 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:53:04.297 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:04.297 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:53:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:05.307 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:53:05.476 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:53:05.607 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:53:05.811 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:53:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:53:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:53:06.484 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:53:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:53:07.052 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:07.210 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:53:07.881 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:53:08.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:53:08.443 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:53:08.668 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:53:09.952 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:53:10.113 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:53:10.361 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:53:10.361 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:53:10.361 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:53:10.361 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:10.361 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:53:10.362 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:53:10.362 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:53:10.362 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:53:10.436 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:53:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:53:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:10.613 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:53:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:10.615 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:10.746 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:10.759 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:53:11.196 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:26 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:11.623 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2020-04-28T12:53:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-noarch 27 k 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:53:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:53:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:53:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:11.628 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:11.628 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:11.628 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2020-04-28T12:53:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:11.629 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 1.9 M 2020-04-28T12:53:11.629 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 23 M 2020-04-28T12:53:11.629 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:11.659 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 882 kB/s | 27 kB 00:00 2020-04-28T12:53:11.661 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 45 MB/s | 126 kB 00:00 2020-04-28T12:53:11.664 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): python3-pyasn1-modules-0.3.7-6.el8.noar 46 MB/s | 110 kB 00:00 2020-04-28T12:53:11.665 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): python3-jsonpointer-1.10-11.el8.noarch. 539 kB/s | 20 kB 00:00 2020-04-28T12:53:11.667 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 53 MB/s | 155 kB 00:00 2020-04-28T12:53:11.667 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 22 MB/s | 43 kB 00:00 2020-04-28T12:53:11.723 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:53:11.724 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 290 kB/s | 16 kB 00:00 2020-04-28T12:53:11.780 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2020-04-28T12:53:11.841 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.el 128 kB/s | 27 kB 00:00 2020-04-28T12:53:11.858 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): python3-kubernetes-10.0.1-2.el8.noarch 14 MB/s | 1.1 MB 00:00 2020-04-28T12:53:11.878 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.1 MB/s | 61 kB 00:00 2020-04-28T12:53:11.892 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:53:12.104 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): python3-cachetools-3.1.1-4.el8.noarch. 75 kB/s | 33 kB 00:00 2020-04-28T12:53:12.130 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:53:12.130 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:53:12.131 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:53:12.235 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): python3-rsa-3.4.2-12.el8.noarch.rpm 184 kB/s | 73 kB 00:00 2020-04-28T12:53:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:Total 3.1 MB/s | 1.9 MB 00:00 2020-04-28T12:53:12.244 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:12.258 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:12.258 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:12.322 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:12.323 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:12.423 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:53:12.423 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:12.423 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:53:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:53:12.425 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:53:12.425 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:53:12.425 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:12.425 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:12.584 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:12.597 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:53:12.814 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:13.043 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:28 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:13.090 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:53:13.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:53:13.427 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:13.429 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:13.429 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-noarch 27 k 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:53:13.430 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:53:13.431 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:53:13.433 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:53:13.433 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:53:13.433 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:53:13.433 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:13.433 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:13.434 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:13.434 INFO:teuthology.orchestra.run.smithi176.stdout:Install 13 Packages 2020-04-28T12:53:13.434 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:13.434 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 1.9 M 2020-04-28T12:53:13.435 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 23 M 2020-04-28T12:53:13.435 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:13.463 INFO:teuthology.orchestra.run.smithi176.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 866 kB/s | 27 kB 00:00 2020-04-28T12:53:13.466 INFO:teuthology.orchestra.run.smithi176.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 42 MB/s | 126 kB 00:00 2020-04-28T12:53:13.467 INFO:teuthology.orchestra.run.smithi176.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 585 kB/s | 20 kB 00:00 2020-04-28T12:53:13.469 INFO:teuthology.orchestra.run.smithi176.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 47 MB/s | 110 kB 00:00 2020-04-28T12:53:13.470 INFO:teuthology.orchestra.run.smithi176.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 28 MB/s | 43 kB 00:00 2020-04-28T12:53:13.471 INFO:teuthology.orchestra.run.smithi176.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 35 MB/s | 155 kB 00:00 2020-04-28T12:53:13.497 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:53:13.518 INFO:teuthology.orchestra.run.smithi176.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 351 kB/s | 16 kB 00:00 2020-04-28T12:53:13.518 INFO:teuthology.orchestra.run.smithi176.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 695 kB/s | 33 kB 00:00 2020-04-28T12:53:13.549 INFO:teuthology.orchestra.run.smithi176.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.6 MB/s | 81 kB 00:00 2020-04-28T12:53:13.565 INFO:teuthology.orchestra.run.smithi176.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-04-28T12:53:13.581 INFO:teuthology.orchestra.run.smithi176.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.8 MB/s | 61 kB 00:00 2020-04-28T12:53:13.615 INFO:teuthology.orchestra.run.smithi176.stdout:(12/13): python3-kubernetes-10.0.1-2.el8.noarch 12 MB/s | 1.1 MB 00:00 2020-04-28T12:53:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:53:13.892 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:53:13.899 INFO:teuthology.orchestra.run.smithi176.stdout:(13/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 58 kB/s | 27 kB 00:00 2020-04-28T12:53:13.900 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:13.901 INFO:teuthology.orchestra.run.smithi176.stdout:Total 4.0 MB/s | 1.9 MB 00:00 2020-04-28T12:53:13.908 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:13.922 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:13.922 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:13.992 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:13.993 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:53:14.390 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:53:14.470 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:14.607 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:53:14.745 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:53:14.963 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:53:15.178 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:53:15.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:53:15.758 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:53:15.933 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:53:15.935 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:53:16.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:53:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:53:16.335 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:53:16.418 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:53:16.656 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:53:17.378 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:53:17.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:53:17.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:53:17.716 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:53:17.920 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:53:17.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:17.920 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:17.920 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:53:17.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:17.922 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:18.001 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:53:18.044 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:18.057 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:53:18.173 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:53:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:53:18.494 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:33 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:18.516 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:53:18.760 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:53:18.760 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:53:18.760 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:53:18.760 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:53:18.760 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:53:18.761 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:53:18.762 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:53:18.762 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:53:18.863 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:18.864 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:18.864 INFO:teuthology.orchestra.run.smithi084.stdout: Package ArchVersion Repository Size 2020-04-28T12:53:18.864 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:18.864 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:18.865 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:18.866 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:18.866 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2020-04-28T12:53:18.866 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:18.866 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 467 k 2020-04-28T12:53:18.867 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 1.4 M 2020-04-28T12:53:18.867 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:18.923 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 845 kB/s | 48 kB 00:00 2020-04-28T12:53:18.942 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 4.6 MB/s | 356 kB 00:00 2020-04-28T12:53:18.970 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 449 kB/s | 21 kB 00:00 2020-04-28T12:53:19.089 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 186 kB/s | 42 kB 00:00 2020-04-28T12:53:19.091 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:19.091 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:53:19.095 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:19.102 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:19.102 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:19.114 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:53:19.115 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:53:19.116 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:53:19.117 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:53:19.117 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:53:19.117 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:19.117 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:19.124 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:19.124 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:19.269 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:19.272 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:19.281 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:53:19.528 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:53:19.721 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:34 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:19.771 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:53:19.934 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:53:20.084 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:20.085 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:20.085 INFO:teuthology.orchestra.run.smithi176.stdout: Package ArchVersion Repository Size 2020-04-28T12:53:20.085 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:53:20.086 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:20.087 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:20.087 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:20.087 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2020-04-28T12:53:20.087 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:20.088 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 467 k 2020-04-28T12:53:20.088 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 1.4 M 2020-04-28T12:53:20.088 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:20.102 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:53:20.145 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 836 kB/s | 48 kB 00:00 2020-04-28T12:53:20.155 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.1 MB/s | 356 kB 00:00 2020-04-28T12:53:20.192 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 455 kB/s | 21 kB 00:00 2020-04-28T12:53:20.300 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:53:20.300 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:53:20.300 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:53:20.300 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:53:20.310 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 186 kB/s | 42 kB 00:00 2020-04-28T12:53:20.312 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:20.312 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:53:20.316 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:20.323 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:20.323 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:20.345 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:20.346 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:20.502 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:20.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:53:20.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:20.536 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:20.537 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:20.687 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:20.701 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-fuse 2020-04-28T12:53:20.766 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:53:21.142 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:36 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:21.496 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:21.497 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2020-04-28T12:53:21.497 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:21.497 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:21.498 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:21.499 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:21.499 INFO:teuthology.orchestra.run.smithi084.stdout:Install 3 Packages 2020-04-28T12:53:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:21.500 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 676 k 2020-04-28T12:53:21.500 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 2.1 M 2020-04-28T12:53:21.500 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:21.544 INFO:teuthology.orchestra.run.smithi084.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.8 MB/s | 82 kB 00:00 2020-04-28T12:53:21.546 INFO:teuthology.orchestra.run.smithi084.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 450 kB/s | 21 kB 00:00 2020-04-28T12:53:21.790 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:53:22.119 INFO:teuthology.orchestra.run.smithi084.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 922 kB/s | 572 kB 00:00 2020-04-28T12:53:22.121 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:22.122 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.1 MB/s | 676 kB 00:00 2020-04-28T12:53:22.125 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:22.146 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:22.147 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:53:22.212 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:22.212 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:53:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:53:22.396 INFO:teuthology.orchestra.run.smithi084.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:53:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:22.566 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:53:22.566 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:53:22.567 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:53:22.567 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:53:22.813 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:53:22.813 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:53:22.814 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:22.815 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:22.941 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:22.954 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-fuse 2020-04-28T12:53:23.099 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:53:23.284 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:53:23.392 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:38 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:23.572 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:53:23.572 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:53:23.572 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:53:23.760 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:53:23.761 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:53:23.762 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:53:23.762 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:53:23.762 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:23.762 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:23.762 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:23.763 INFO:teuthology.orchestra.run.smithi176.stdout:Install 3 Packages 2020-04-28T12:53:23.763 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:23.763 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 676 k 2020-04-28T12:53:23.764 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 2.1 M 2020-04-28T12:53:23.764 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:23.793 INFO:teuthology.orchestra.run.smithi176.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 82 kB 00:00 2020-04-28T12:53:23.796 INFO:teuthology.orchestra.run.smithi176.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 627 kB/s | 21 kB 00:00 2020-04-28T12:53:23.820 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:53:23.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:23.820 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:23.820 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:53:23.820 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:53:23.821 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:23.821 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:24.096 INFO:teuthology.orchestra.run.smithi176.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.7 MB/s | 572 kB 00:00 2020-04-28T12:53:24.097 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:24.098 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.0 MB/s | 676 kB 00:00 2020-04-28T12:53:24.101 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:24.122 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:24.122 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:24.132 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:24.146 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install librados-devel 2020-04-28T12:53:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:24.351 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:24.352 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:53:24.352 INFO:teuthology.orchestra.run.smithi176.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:53:24.352 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:24.592 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:39 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:24.734 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:53:24.880 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:53:24.945 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:24.946 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:24.946 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2020-04-28T12:53:24.946 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:24.946 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:24.947 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 141 k 2020-04-28T12:53:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 487 k 2020-04-28T12:53:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:25.204 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:53:25.204 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:53:25.205 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:53:25.205 INFO:teuthology.orchestra.run.smithi084.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 544 kB/s | 141 kB 00:00 2020-04-28T12:53:25.206 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:25.206 INFO:teuthology.orchestra.run.smithi084.stdout:Total 542 kB/s | 141 kB 00:00 2020-04-28T12:53:25.208 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:25.215 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:25.216 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:25.264 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:25.264 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:25.375 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:25.509 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:53:25.510 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:25.510 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:25.510 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:53:25.510 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:53:25.510 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:25.511 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:25.574 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:25.761 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:25.775 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install librados-devel 2020-04-28T12:53:25.776 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:25.999 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:25.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:26.000 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:26.000 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:26.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:26.000 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:26.224 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:26.313 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:26.327 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs2 2020-04-28T12:53:26.595 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:26.595 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:26.595 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2020-04-28T12:53:26.595 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:53:26.596 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:26.597 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 141 k 2020-04-28T12:53:26.597 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 487 k 2020-04-28T12:53:26.597 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:26.770 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:26.871 INFO:teuthology.orchestra.run.smithi176.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 512 kB/s | 141 kB 00:00 2020-04-28T12:53:26.872 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:26.872 INFO:teuthology.orchestra.run.smithi176.stdout:Total 510 kB/s | 141 kB 00:00 2020-04-28T12:53:26.874 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:26.881 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:26.881 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:26.929 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:26.929 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:27.056 INFO:teuthology.orchestra.run.smithi084.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:27.156 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:27.158 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:27.158 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:27.286 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:27.299 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs-devel 2020-04-28T12:53:27.471 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:27.708 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:27.740 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:42 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:27.963 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:27.963 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:27.963 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:27.964 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:27.964 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:27.964 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:28.103 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:28.104 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:28.104 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2020-04-28T12:53:28.104 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:28.104 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:53:28.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:28.106 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 21 k 2020-04-28T12:53:28.106 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 76 k 2020-04-28T12:53:28.106 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:28.268 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:28.282 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs2 2020-04-28T12:53:28.299 INFO:teuthology.orchestra.run.smithi084.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 110 kB/s | 21 kB 00:00 2020-04-28T12:53:28.299 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:28.300 INFO:teuthology.orchestra.run.smithi084.stdout:Total 109 kB/s | 21 kB 00:00 2020-04-28T12:53:28.302 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:28.306 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:28.306 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:28.308 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:28.308 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:28.358 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:28.523 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:28.691 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:28.728 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:43 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:28.918 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:28.919 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:29.039 INFO:teuthology.orchestra.run.smithi176.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:29.044 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:29.058 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install librados2 2020-04-28T12:53:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:29.147 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:29.273 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:29.287 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs-devel 2020-04-28T12:53:29.499 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:29.727 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:29.774 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:29.876 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:29.877 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:29.877 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:30.000 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:30.013 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install librbd1 2020-04-28T12:53:30.108 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:30.109 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:30.109 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2020-04-28T12:53:30.109 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:30.109 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:53:30.110 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:30.111 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 21 k 2020-04-28T12:53:30.111 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 76 k 2020-04-28T12:53:30.111 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:30.452 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:45 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:30.537 INFO:teuthology.orchestra.run.smithi176.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 50 kB/s | 21 kB 00:00 2020-04-28T12:53:30.537 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:30.538 INFO:teuthology.orchestra.run.smithi176.stdout:Total 50 kB/s | 21 kB 00:00 2020-04-28T12:53:30.540 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:30.544 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:30.544 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:30.546 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:30.546 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:30.597 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:30.723 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:30.795 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:30.825 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:30.826 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:30.827 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:30.952 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:30.965 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rados 2020-04-28T12:53:30.975 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:31.203 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:31.203 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:31.203 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:31.203 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:31.203 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:31.204 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:31.358 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:31.371 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install librados2 2020-04-28T12:53:31.405 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:31.648 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:31.751 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:31.752 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:31.752 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:31.814 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:31.882 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:31.896 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rgw 2020-04-28T12:53:32.063 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:32.165 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:32.166 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:32.166 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:32.306 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:32.319 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install librbd1 2020-04-28T12:53:32.334 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:32.573 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:32.678 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:32.678 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:32.678 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:32.761 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:32.807 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:32.820 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-cephfs 2020-04-28T12:53:33.021 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:33.124 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:33.125 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:33.125 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:33.264 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:48 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:33.275 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:33.289 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rados 2020-04-28T12:53:33.731 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:48 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:33.852 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:33.956 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:33.957 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:33.957 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:33.987 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:34.090 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:34.092 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:34.092 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:34.118 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:34.131 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rbd 2020-04-28T12:53:34.222 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:34.236 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rgw 2020-04-28T12:53:34.572 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:34.677 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:34.831 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:34.934 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:34.935 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-28T12:53:34.935 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:34.962 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:35.065 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:35.066 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:35.066 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:35.082 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:35.095 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-fuse 2020-04-28T12:53:35.199 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:35.211 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-cephfs 2020-04-28T12:53:35.535 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:50 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:35.653 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:50 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:35.893 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:53:35.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:35.895 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:35.895 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:35.895 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:53:35.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:35.896 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 72 k 2020-04-28T12:53:35.896 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 230 k 2020-04-28T12:53:35.896 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:35.912 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:36.016 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:36.017 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:36.017 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:36.165 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:36.178 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rbd 2020-04-28T12:53:36.620 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:51 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 85 kB/s | 72 kB 00:00 2020-04-28T12:53:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:Total 85 kB/s | 72 kB 00:00 2020-04-28T12:53:36.747 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:36.760 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:36.760 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:36.814 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:36.814 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:36.879 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:53:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:36.981 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:36.982 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2020-04-28T12:53:36.983 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:37.096 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:37.113 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:37.126 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-fuse 2020-04-28T12:53:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:37.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:37.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:37.541 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:37.541 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:37.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:37.541 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:37.569 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:52 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:37.817 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:37.831 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-mirror 2020-04-28T12:53:37.932 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:37.933 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:37.933 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2020-04-28T12:53:37.933 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:37.933 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:37.933 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:53:37.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:37.934 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:37.934 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:37.934 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:53:37.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:37.935 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 72 k 2020-04-28T12:53:37.935 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 230 k 2020-04-28T12:53:37.935 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:38.276 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:53 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:38.464 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 137 kB/s | 72 kB 00:00 2020-04-28T12:53:38.464 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:38.465 INFO:teuthology.orchestra.run.smithi176.stdout:Total 136 kB/s | 72 kB 00:00 2020-04-28T12:53:38.467 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:38.479 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:38.479 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:38.532 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:38.533 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:38.658 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:38.658 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:38.658 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2020-04-28T12:53:38.658 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:38.659 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:53:38.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:38.660 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.7 M 2020-04-28T12:53:38.660 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 13 M 2020-04-28T12:53:38.660 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:39.029 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:39.369 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:39.840 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:40.123 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:40.137 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-mirror 2020-04-28T12:53:40.367 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 1.6 MB/s | 2.7 MB 00:01 2020-04-28T12:53:40.368 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:40.369 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.6 MB/s | 2.7 MB 00:01 2020-04-28T12:53:40.371 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:40.385 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:40.386 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:40.449 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:40.450 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:40.583 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:55 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:40.950 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:40.950 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:40.951 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:40.952 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:40.952 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:53:40.952 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:40.953 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 2.7 M 2020-04-28T12:53:40.953 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 13 M 2020-04-28T12:53:40.953 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:40.968 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:41.131 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:41.443 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:41.685 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 3.7 MB/s | 2.7 MB 00:00 2020-04-28T12:53:41.685 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:41.685 INFO:teuthology.orchestra.run.smithi176.stdout:Total 3.7 MB/s | 2.7 MB 00:00 2020-04-28T12:53:41.687 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:41.697 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:41.698 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:41.698 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:41.698 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:41.698 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:41.698 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:41.701 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:41.701 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:41.758 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:41.759 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:41.940 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:42.234 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:42.250 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-nbd 2020-04-28T12:53:42.288 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:42.589 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:42.701 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:57 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:42.833 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:42.833 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:42.833 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:42.834 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:42.834 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:42.834 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:43.059 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-28T12:53:43.060 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:43.060 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-28T12:53:43.060 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:43.060 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:43.061 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 141 k 2020-04-28T12:53:43.062 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 526 k 2020-04-28T12:53:43.062 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-28T12:53:43.159 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:43.174 INFO:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-nbd 2020-04-28T12:53:43.320 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 544 kB/s | 141 kB 00:00 2020-04-28T12:53:43.321 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:43.321 INFO:teuthology.orchestra.run.smithi084.stdout:Total 541 kB/s | 141 kB 00:00 2020-04-28T12:53:43.323 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-28T12:53:43.334 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-28T12:53:43.334 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-28T12:53:43.383 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-28T12:53:43.383 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-28T12:53:43.487 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-28T12:53:43.624 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:58 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:53:43.678 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:43.869 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:44.007 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:53:44.008 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 141 k 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 526 k 2020-04-28T12:53:44.009 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:53:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:44.128 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-28T12:53:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:44.128 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-28T12:53:44.286 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 510 kB/s | 141 kB 00:00 2020-04-28T12:53:44.286 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:44.287 INFO:teuthology.orchestra.run.smithi176.stdout:Total 508 kB/s | 141 kB 00:00 2020-04-28T12:53:44.289 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:53:44.299 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:53:44.299 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:53:44.348 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:53:44.348 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:53:44.418 DEBUG:teuthology.parallel:result is None 2020-04-28T12:53:44.461 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:53:45.593 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:45.835 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:46.096 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:53:46.096 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:46.096 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:53:46.096 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:53:46.096 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:46.097 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:53:46.406 DEBUG:teuthology.parallel:result is None 2020-04-28T12:53:46.406 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:46.419 INFO:teuthology.orchestra.run.smithi176:> sudo lsb_release -is 2020-04-28T12:53:46.499 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS 2020-04-28T12:53:46.499 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:53:46.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:53:46.754 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:46.767 INFO:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:53:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:46.825 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:46.826 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:53:46.826 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:46.843 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-28T12:53:46.924 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-28T12:53:46.925 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:53:46.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:53:47.169 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:47.186 INFO:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:53:47.251 INFO:teuthology.orchestra.run.smithi084.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:47.252 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:53:47.252 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:53:47.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-28T12:53:47.252 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:47.266 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:53:47.333 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:47.350 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:53:47.423 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-28T12:53:47.423 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:47.436 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:53:47.503 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:47.556 INFO:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:53:47.623 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:47.639 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:53:47.714 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:47.769 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:53:47.838 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-28T12:53:47.838 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:47.852 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:53:47.936 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:47.990 INFO:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:53:48.056 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.072 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:53:48.157 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.212 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:53:48.280 INFO:teuthology.run_tasks:Running task ceph... 2020-04-28T12:53:48.354 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-28T12:53:48.355 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.369 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2020-04-28T12:53:48.412 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:48.426 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2020-04-28T12:53:48.494 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-28T12:53:48.494 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.508 INFO:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:53:48.550 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:48.563 INFO:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:53:48.630 INFO:tasks.ceph:Creating extra log directories... 2020-04-28T12:53:48.630 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.644 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:53:48.686 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:48.699 INFO:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:53:48.766 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-28T12:53:48.767 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'debug ms': 20, 'debug journal': 20, 'lockdep': True, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}} 2020-04-28T12:53:48.767 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'sleep_before_teardown': 0, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.19065', 'owner': 'scheduled_teuthology@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi176.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkTSJ2OfPO8MkiexMqJ9tT81zvoD0XQuLKCQ1pOUS7lZF4l8ISga8JStvkQlvs1BXyEFKdiZADD+YIK50qznQgpjQQygbqsRHf9CU/44JkKufj+QBf1FMaNZg27Zn5k5u9Ccjrw/g7137OZTn95WRmcCaqw4K7VVxxmb4OpLYBZJJLLNDU+Y31We+WiEC9Vhv9Do/ADNLG59j3fCYS0+vlIX82fKfJJnA9aIq0UO4v1YK671X4u6Tz0U/JCmXkb0gj7UNptRDqlR9ywlvzEG9tByAghJYZXE7iZH45G1U8MekQ3UilHf/uFJHqQM4K6C8e3576vh7DUgNSMO20KA4PFObBDDMHCKQ4Vs2r752i5bv1H9fE4ze9YDetPXiVPBFtvoA5vXhCrQtbq4TB94i0/CifoTOf+WEgVqWjRr/kuh4wFAMUTyhSU6Mhi5ol76pBS0epgfKbqbTwh0EDvlSzm2VV9og8iRtwyIQFIfTtNB2aU2gFI/Le1r4ORZq+MJU=', 'smithi084.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNGXiaV/5kdpLNx1yyS0/Z64X24gt79knyw6+GNFCdbqAl5iBEaeSPJAv48p5xAcezn14M3rJoZphXfO7DcNFLBcCKTyz4RHC18l/MF34btOpZA9DBMFaJBOWXrI6u/Geu8v9AVunHQVlw2ZRQfMyW2pqpLZX/iGQWwxFlSxLsLDdTMk/LefcYjInpf2/EJQArCUbX1D+s+rvasuBPNYl/2YfyzrZAMaffvbMtcmHHfxKBOVexaPPAW7aR0d1nv/HXl5pxLXYS6CqDKGmzsdN4nAWHxhvq/2Wivz+CKlEw1oRrn7MTv2QCDrK4zFEGVJRMpLY5Hw1auJKweb1GGVlvO56N6T8i66i8CIZx+YF/4zork5bjs2AHeQz9EAsJ37AgIGv7CW0Ut+JwRmtnZJIFvBiwvXFhdvdvsQgs9XaV4i8BjU99ZsZG1sr3035KeFJcACzFozlhu855GKRQ9OMVKRE1Qq7Lcl6UUQP8ke8exWbI2RYyMpR9GqjvpNGnwV0='}, 'verbose': True, 'job_id': '4990045', 'tube': 'smithi', 'suite_branch': 'octopus', 'priority': 1000, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'octopus', 'suite': 'rgw', 'email': 'ceph-qa@ceph.io', 'archive_path': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990045', 'description': 'rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'py2', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'name': 'teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'debug ms': 20, 'debug journal': 20, 'lockdep': True, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}, 'fs': 'xfs', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'install': {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}}, 'rgw': {'frontend': 'beast', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': False}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'admin_socket': {'branch': 'octopus'}, 'workunit': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'branch': 'octopus'}}, 'os_type': 'centos', 'suite_sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:53:48.767 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.781 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:53:48.823 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:48.837 INFO:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:53:48.890 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:48.903 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:53:48.945 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:48.958 INFO:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:53:49.084 DEBUG:teuthology.orchestra.remote:smithi176:/scratch_devs is 72B 2020-04-28T12:53:49.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:53:49.136 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:49.148 INFO:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:53:49.201 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:53:49.201 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.202 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 61164 Links: 1 2020-04-28T12:53:49.202 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.202 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.206 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2020-04-28 12:53:42.421885337 +0000 2020-04-28T12:53:49.206 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2020-04-28 12:51:25.177859418 +0000 2020-04-28T12:53:49.206 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2020-04-28 12:51:25.177859418 +0000 2020-04-28T12:53:49.207 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2020-04-28T12:53:49.214 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2020-04-28T12:53:49.214 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2020-04-28T12:53:49.215 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000226217 s, 2.3 MB/s 2020-04-28T12:53:49.217 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:49.270 INFO:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:53:49.323 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 64033 Links: 1 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2020-04-28 12:53:42.421885337 +0000 2020-04-28T12:53:49.324 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2020-04-28 12:51:25.509854294 +0000 2020-04-28T12:53:49.325 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2020-04-28 12:51:25.509854294 +0000 2020-04-28T12:53:49.325 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2020-04-28T12:53:49.336 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2020-04-28T12:53:49.337 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2020-04-28T12:53:49.337 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.00017531 s, 2.9 MB/s 2020-04-28T12:53:49.339 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:49.393 INFO:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:53:49.448 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:53:49.448 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.448 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 64953 Links: 1 2020-04-28T12:53:49.448 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.448 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.449 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2020-04-28 12:53:42.421885337 +0000 2020-04-28T12:53:49.449 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2020-04-28 12:51:25.835849263 +0000 2020-04-28T12:53:49.449 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2020-04-28 12:51:25.835849263 +0000 2020-04-28T12:53:49.449 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2020-04-28T12:53:49.461 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2020-04-28T12:53:49.461 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2020-04-28T12:53:49.462 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000211109 s, 2.4 MB/s 2020-04-28T12:53:49.463 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:49.517 INFO:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:53:49.571 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:53:49.571 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 66149 Links: 1 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2020-04-28 12:53:42.421885337 +0000 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2020-04-28 12:51:26.195843708 +0000 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2020-04-28 12:51:26.195843708 +0000 2020-04-28T12:53:49.572 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2020-04-28T12:53:49.584 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2020-04-28T12:53:49.585 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2020-04-28T12:53:49.585 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000229688 s, 2.2 MB/s 2020-04-28T12:53:49.587 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:49.605 DEBUG:teuthology.orchestra.remote:smithi084:/scratch_devs is 72B 2020-04-28T12:53:49.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:53:49.653 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:49.667 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:53:49.722 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 63987 Links: 1 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-28 12:53:41.279008118 +0000 2020-04-28T12:53:49.723 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-28 12:51:25.134035852 +0000 2020-04-28T12:53:49.724 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-28 12:51:25.134035852 +0000 2020-04-28T12:53:49.724 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-28T12:53:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-28T12:53:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-28T12:53:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000221857 s, 2.3 MB/s 2020-04-28T12:53:49.739 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:49.793 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:53:49.847 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:53:49.847 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.847 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 64051 Links: 1 2020-04-28T12:53:49.847 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.848 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.849 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-28 12:53:41.279008118 +0000 2020-04-28T12:53:49.849 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-28 12:51:25.461030022 +0000 2020-04-28T12:53:49.850 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-28 12:51:25.461030022 +0000 2020-04-28T12:53:49.850 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-28T12:53:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-28T12:53:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-28T12:53:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000280677 s, 1.8 MB/s 2020-04-28T12:53:49.863 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:49.916 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:53:49.969 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 64112 Links: 1 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-28 12:53:41.279008118 +0000 2020-04-28T12:53:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-28 12:51:25.793024103 +0000 2020-04-28T12:53:49.971 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-28 12:51:25.793024103 +0000 2020-04-28T12:53:49.971 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-28T12:53:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-28T12:53:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-28T12:53:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000180868 s, 2.8 MB/s 2020-04-28T12:53:49.986 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:50.042 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:53:50.096 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:53:50.096 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:53:50.096 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 64170 Links: 1 2020-04-28T12:53:50.096 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:53:50.096 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:53:50.097 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-28 12:53:41.279008118 +0000 2020-04-28T12:53:50.097 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-28 12:51:26.160017561 +0000 2020-04-28T12:53:50.097 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-28 12:51:26.160017561 +0000 2020-04-28T12:53:50.097 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-28T12:53:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-28T12:53:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-28T12:53:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000248602 s, 2.1 MB/s 2020-04-28T12:53:50.111 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:50.111 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:53:50.112 INFO:tasks.ceph:Generating config... 2020-04-28T12:53:50.113 INFO:tasks.ceph:[mgr] debug ms = 1 2020-04-28T12:53:50.113 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-04-28T12:53:50.113 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2020-04-28T12:53:50.113 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-04-28T12:53:50.113 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2020-04-28T12:53:50.114 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-04-28T12:53:50.114 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1999 2020-04-28T12:53:50.114 INFO:tasks.ceph:[osd] debug ms = 20 2020-04-28T12:53:50.114 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-28T12:53:50.114 INFO:tasks.ceph:[osd] lockdep = True 2020-04-28T12:53:50.114 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-28T12:53:50.114 INFO:tasks.ceph:[osd] osd objectstore = filestore 2020-04-28T12:53:50.115 INFO:tasks.ceph:[osd] osd sloppy crc = True 2020-04-28T12:53:50.115 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-28T12:53:50.115 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-04-28T12:53:50.115 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-28T12:53:50.115 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-28T12:53:50.115 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-28T12:53:50.115 INFO:tasks.ceph:[mon] lockdep = True 2020-04-28T12:53:50.115 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] debug rgw = 20 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2020-04-28T12:53:50.116 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2020-04-28T12:53:50.116 INFO:tasks.ceph:Setting up mon.a... 2020-04-28T12:53:50.117 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.134 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-28T12:53:50.219 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.keyring 2020-04-28T12:53:50.221 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.234 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-28T12:53:50.315 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.368 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:53:50.434 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]'), ('mon.b', '172.21.15.84')] 2020-04-28T12:53:50.434 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.488 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --add b 172.21.15.84 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:50.564 INFO:teuthology.orchestra.run.smithi176.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:50.564 INFO:teuthology.orchestra.run.smithi176.stdout:monmaptool: generated fsid 37ce95df-7d75-45e8-8120-5a8ac98fc95b 2020-04-28T12:53:50.564 INFO:teuthology.orchestra.run.smithi176.stdout:epoch 0 2020-04-28T12:53:50.564 INFO:teuthology.orchestra.run.smithi176.stdout:fsid 37ce95df-7d75-45e8-8120-5a8ac98fc95b 2020-04-28T12:53:50.564 INFO:teuthology.orchestra.run.smithi176.stdout:last_changed 2020-04-28T12:53:50.560566+0000 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:created 2020-04-28T12:53:50.560566+0000 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:min_mon_release 0 (unknown) 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:0: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.a 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:1: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2020-04-28T12:53:50.565 INFO:teuthology.orchestra.run.smithi176.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-28T12:53:50.566 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 37ce95df-7d75-45e8-8120-5a8ac98fc95b... 2020-04-28T12:53:50.567 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:50.581 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:53:50.623 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.636 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:53:50.680 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2020-04-28T12:53:50.680 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2020-04-28T12:53:50.680 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:53:50.680 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2020-04-28T12:53:50.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2020-04-28T12:53:50.681 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2020-04-28T12:53:50.682 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.682 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2020-04-28T12:53:50.682 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2020-04-28T12:53:50.682 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.682 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2020-04-28T12:53:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:53:50.684 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2020-04-28T12:53:50.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.686 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2020-04-28T12:53:50.686 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.686 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2020-04-28T12:53:50.686 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2020-04-28T12:53:50.686 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790],172.21.15.84" 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject socket failures = 5000 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: mon client directed command retry = 5 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 37ce95df-7d75-45e8-8120-5a8ac98fc95b 2020-04-28T12:53:50.687 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.688 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2020-04-28T12:53:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.690 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2020-04-28T12:53:50.690 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2020-04-28T12:53:50.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.690 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:53:50.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2020-04-28T12:53:50.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.692 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2020-04-28T12:53:50.692 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2020-04-28T12:53:50.700 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 20 2020-04-28T12:53:50.700 INFO:teuthology.orchestra.run.smithi084.stdout: debug journal = 20 2020-04-28T12:53:50.700 INFO:teuthology.orchestra.run.smithi084.stdout: lockdep = True 2020-04-28T12:53:50.700 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 25 2020-04-28T12:53:50.700 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = filestore 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: osd sloppy crc = True 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: debug filestore = 20 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: osd shutdown pgref assert = True 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-28T12:53:50.701 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.702 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2020-04-28T12:53:50.703 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: lockdep = True 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2020-04-28T12:53:50.704 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: rgw crypt require ssl = False 2020-04-28T12:53:50.705 INFO:teuthology.orchestra.run.smithi084.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: debug rgw = 20 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: rgw max chunk size = 4194304 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: rgw lc debug interval = 10 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout: rgw obj stripe size = 6291456 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2020-04-28T12:53:50.706 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2020-04-28T12:53:50.707 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2020-04-28T12:53:50.729 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2020-04-28T12:53:50.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.731 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:53:50.732 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:53:50.733 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.733 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2020-04-28T12:53:50.736 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.736 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:53:50.737 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2020-04-28T12:53:50.738 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:53:50.738 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:53:50.738 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.739 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:53:50.739 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.739 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2020-04-28T12:53:50.739 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.739 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790],172.21.15.84" 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: ms inject socket failures = 5000 2020-04-28T12:53:50.740 INFO:teuthology.orchestra.run.smithi176.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout: mon client directed command retry = 5 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 37ce95df-7d75-45e8-8120-5a8ac98fc95b 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2020-04-28T12:53:50.741 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2020-04-28T12:53:50.742 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.743 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2020-04-28T12:53:50.744 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.745 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2020-04-28T12:53:50.748 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.749 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:53:50.749 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2020-04-28T12:53:50.749 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.750 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2020-04-28T12:53:50.750 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2020-04-28T12:53:50.750 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 20 2020-04-28T12:53:50.750 INFO:teuthology.orchestra.run.smithi176.stdout: debug journal = 20 2020-04-28T12:53:50.750 INFO:teuthology.orchestra.run.smithi176.stdout: lockdep = True 2020-04-28T12:53:50.751 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 25 2020-04-28T12:53:50.751 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = filestore 2020-04-28T12:53:50.751 INFO:teuthology.orchestra.run.smithi176.stdout: osd sloppy crc = True 2020-04-28T12:53:50.753 INFO:teuthology.orchestra.run.smithi176.stdout: debug filestore = 20 2020-04-28T12:53:50.753 INFO:teuthology.orchestra.run.smithi176.stdout: osd shutdown pgref assert = True 2020-04-28T12:53:50.753 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2020-04-28T12:53:50.754 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:53:50.755 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:53:50.755 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2020-04-28T12:53:50.756 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.757 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2020-04-28T12:53:50.757 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2020-04-28T12:53:50.758 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:53:50.759 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2020-04-28T12:53:50.759 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2020-04-28T12:53:50.761 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout: lockdep = True 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2020-04-28T12:53:50.762 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2020-04-28T12:53:50.763 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:53:50.763 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:53:50.764 INFO:teuthology.orchestra.run.smithi176.stdout: rgw crypt require ssl = False 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: debug rgw = 20 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: rgw max chunk size = 4194304 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: rgw lc debug interval = 10 2020-04-28T12:53:50.765 INFO:teuthology.orchestra.run.smithi176.stdout: rgw obj stripe size = 6291456 2020-04-28T12:53:50.766 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2020-04-28T12:53:50.766 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2020-04-28T12:53:50.766 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2020-04-28T12:53:50.767 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-28T12:53:50.767 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:50.781 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-28T12:53:50.873 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-28T12:53:50.890 DEBUG:teuthology.orchestra.remote:smithi176:/etc/ceph/ceph.keyring is 206B 2020-04-28T12:53:50.983 DEBUG:teuthology.orchestra.remote:smithi176:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-28T12:53:51.031 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:53:51.031 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:51.044 INFO:teuthology.orchestra.run.smithi176:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:53:51.141 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:51.195 INFO:teuthology.orchestra.run.smithi176:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:51.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:53:51.280 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:51.294 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:53:51.392 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:51.446 INFO:teuthology.orchestra.run.smithi084:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:51.529 INFO:tasks.ceph:Setting up mon nodes... 2020-04-28T12:53:51.529 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-28T12:53:51.530 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:51.543 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:53:51.636 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:53:51.638 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:51.652 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:53:51.757 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:53:51.759 INFO:tasks.ceph:Setting up mds nodes... 2020-04-28T12:53:51.759 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-28T12:53:51.759 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:51.772 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-28T12:53:51.852 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-28T12:53:51.867 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:51.881 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-04-28T12:53:51.960 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-04-28T12:53:51.976 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-28T12:53:51.977 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:53:51.977 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:51.990 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-28T12:53:52.057 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:52.057 INFO:tasks.ceph:role: osd.0 2020-04-28T12:53:52.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:53:52.058 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:52.111 INFO:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:53:52.650 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:52.651 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:52.652 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:52.652 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:52.652 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:52.653 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2020-04-28T12:53:52.653 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:52.667 INFO:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-28T12:53:52.821 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:52.835 INFO:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-28T12:53:52.905 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:52.959 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-28T12:53:53.025 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:53.025 INFO:tasks.ceph:role: osd.1 2020-04-28T12:53:53.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:53:53.026 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:53.079 INFO:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:53:53.590 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:53.590 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:53.590 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:53.590 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2020-04-28T12:53:53.590 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:53.591 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:53.591 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:53.591 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:53.591 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:53.591 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:53.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2020-04-28T12:53:53.592 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:53.605 INFO:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-28T12:53:53.716 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:53.730 INFO:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-28T12:53:53.800 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:53.853 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-28T12:53:53.919 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:53.919 INFO:tasks.ceph:role: osd.2 2020-04-28T12:53:53.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:53:53.920 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:53.973 INFO:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:53:54.510 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:54.511 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:54.511 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:54.511 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2020-04-28T12:53:54.511 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:54.511 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:54.512 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:54.512 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:54.512 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:54.512 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:54.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2020-04-28T12:53:54.513 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:54.527 INFO:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-28T12:53:54.680 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:54.693 INFO:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-28T12:53:54.763 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:54.816 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-28T12:53:54.882 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:54.882 INFO:tasks.ceph:role: osd.3 2020-04-28T12:53:54.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T12:53:54.883 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:54.936 INFO:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:53:55.442 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:55.442 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:55.443 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:55.444 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:55.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2020-04-28T12:53:55.445 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:55.458 INFO:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-28T12:53:55.558 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:55.571 INFO:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-28T12:53:55.642 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:55.695 INFO:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:55.777 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.772+0000 7f341beb8ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-28T12:53:55.778 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.772+0000 7f341beb8ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-28T12:53:55.789 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.784+0000 7f341beb8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:55.789 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.785+0000 7f341beb8ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:53:55.991 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.986+0000 7f341beb8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:55.993 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.988+0000 7f341beb8ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:55.993 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:55.988+0000 7f341beb8ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:56.010 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:56.064 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-28T12:53:56.132 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:56.185 INFO:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:56.269 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.264+0000 7f0f56b3dec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-28T12:53:56.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.265+0000 7f0f56b3dec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-28T12:53:56.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.289+0000 7f0f56b3dec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:56.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.289+0000 7f0f56b3dec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:53:56.489 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.484+0000 7f0f56b3dec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:56.490 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.485+0000 7f0f56b3dec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:56.490 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.485+0000 7f0f56b3dec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:56.502 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:56.515 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-28T12:53:56.582 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:56.635 INFO:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:56.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.713+0000 7f471c98bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-28T12:53:56.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.713+0000 7f471c98bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-28T12:53:56.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.719+0000 7f471c98bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:56.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.719+0000 7f471c98bec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:53:56.867 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.861+0000 7f471c98bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:56.867 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.861+0000 7f471c98bec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:56.867 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:56.861+0000 7f471c98bec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:56.873 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:56.930 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-28T12:53:56.996 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:57.050 INFO:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:53:57.133 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.128+0000 7fe370dfdec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-28T12:53:57.133 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.128+0000 7fe370dfdec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-28T12:53:57.137 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.132+0000 7fe370dfdec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:57.137 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.132+0000 7fe370dfdec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:53:57.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.255+0000 7fe370dfdec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:53:57.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.256+0000 7fe370dfdec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:57.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:53:57.256+0000 7fe370dfdec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:53:57.267 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:53:57.280 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-28T12:53:57.346 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:57.362 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-28T12:53:57.434 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:57.435 INFO:tasks.ceph:role: osd.4 2020-04-28T12:53:57.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:53:57.435 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:57.490 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:53:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:58.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-28T12:53:58.012 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:58.028 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-28T12:53:58.174 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:58.188 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-28T12:53:58.262 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:58.316 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-28T12:53:58.384 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:58.385 INFO:tasks.ceph:role: osd.5 2020-04-28T12:53:58.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:53:58.385 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:58.439 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:53:58.932 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:58.932 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:58.933 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:58.934 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:58.934 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-28T12:53:58.935 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:58.949 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-28T12:53:59.055 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:59.069 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-28T12:53:59.139 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:59.192 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-28T12:53:59.260 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:53:59.260 INFO:tasks.ceph:role: osd.6 2020-04-28T12:53:59.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:53:59.260 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:59.313 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:53:59.833 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:53:59.834 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:53:59.835 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:53:59.835 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:53:59.835 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:53:59.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-28T12:53:59.836 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:53:59.849 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-28T12:53:59.999 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:00.012 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-28T12:54:00.081 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:00.135 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-28T12:54:00.201 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:54:00.201 INFO:tasks.ceph:role: osd.7 2020-04-28T12:54:00.201 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T12:54:00.202 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:00.254 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:54:00.766 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:54:00.766 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:54:00.766 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:54:00.766 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-28T12:54:00.766 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:54:00.767 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:54:00.767 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:54:00.767 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:54:00.767 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:54:00.767 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:54:00.768 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-28T12:54:00.768 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:00.782 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-28T12:54:00.888 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:00.901 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-28T12:54:00.970 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:01.023 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.104+0000 7faa9d724ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-28T12:54:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.106+0000 7faa9d724ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-28T12:54:01.118 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.113+0000 7faa9d724ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:01.120 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.115+0000 7faa9d724ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:54:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.301+0000 7faa9d724ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:01.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.301+0000 7faa9d724ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:01.307 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.301+0000 7faa9d724ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:01.318 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:01.331 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-28T12:54:01.399 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:01.452 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:01.535 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.530+0000 7fddcfe5eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-28T12:54:01.537 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.532+0000 7fddcfe5eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-28T12:54:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.559+0000 7fddcfe5eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.559+0000 7fddcfe5eec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:54:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.746+0000 7fddcfe5eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.747+0000 7fddcfe5eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:01.747+0000 7fddcfe5eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:01.765 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:01.818 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-28T12:54:01.885 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:01.938 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:02.020 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.015+0000 7f8d8b130ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-28T12:54:02.021 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.015+0000 7f8d8b130ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-28T12:54:02.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.019+0000 7f8d8b130ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:02.025 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.019+0000 7f8d8b130ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:54:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.163+0000 7f8d8b130ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:02.168 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.163+0000 7f8d8b130ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:02.169 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.163+0000 7f8d8b130ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:02.175 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:02.228 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-28T12:54:02.296 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:02.349 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.430+0000 7f1505285ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-28T12:54:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.430+0000 7f1505285ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-28T12:54:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.434+0000 7f1505285ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.434+0000 7f1505285ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:54:02.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.569+0000 7f1505285ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:02.576 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.569+0000 7f1505285ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:02.577 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-28T12:54:02.569+0000 7f1505285ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:54:02.583 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:02.646 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-28T12:54:02.718 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-28T12:54:02.718 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:02.738 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:02.803 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.LF8NUar7JO 2020-04-28T12:54:02.803 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:02.861 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.LF8NUar7JO 2020-04-28T12:54:02.934 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:02.991 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.LF8NUar7JO 2020-04-28T12:54:03.120 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.LF8NUar7JO is 56B 2020-04-28T12:54:03.168 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.182 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.LF8NUar7JO 2020-04-28T12:54:03.236 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.289 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:03.342 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.CLFpWVJfsf 2020-04-28T12:54:03.343 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.396 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.CLFpWVJfsf 2020-04-28T12:54:03.462 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.517 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.CLFpWVJfsf 2020-04-28T12:54:03.641 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.CLFpWVJfsf is 56B 2020-04-28T12:54:03.690 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.704 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.CLFpWVJfsf 2020-04-28T12:54:03.758 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.811 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:03.864 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.lSNnnfpadu 2020-04-28T12:54:03.865 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:03.918 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.lSNnnfpadu 2020-04-28T12:54:03.985 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.038 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.lSNnnfpadu 2020-04-28T12:54:04.161 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.lSNnnfpadu is 56B 2020-04-28T12:54:04.211 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.223 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.lSNnnfpadu 2020-04-28T12:54:04.276 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.328 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:04.383 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.0ZB4V7v3MN 2020-04-28T12:54:04.383 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.437 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.0ZB4V7v3MN 2020-04-28T12:54:04.504 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.557 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.0ZB4V7v3MN 2020-04-28T12:54:04.680 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.0ZB4V7v3MN is 56B 2020-04-28T12:54:04.729 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.742 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.0ZB4V7v3MN 2020-04-28T12:54:04.795 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.849 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:04.903 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.rdcLXtRtnZ 2020-04-28T12:54:04.903 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:04.956 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.rdcLXtRtnZ 2020-04-28T12:54:05.023 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:05.076 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.rdcLXtRtnZ 2020-04-28T12:54:05.199 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.rdcLXtRtnZ is 56B 2020-04-28T12:54:05.247 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:05.260 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.rdcLXtRtnZ 2020-04-28T12:54:05.313 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.329 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.QYowt830IP 2020-04-28T12:54:05.386 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.440 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.QYowt830IP 2020-04-28T12:54:05.512 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.567 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.QYowt830IP 2020-04-28T12:54:05.694 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.QYowt830IP is 56B 2020-04-28T12:54:05.743 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.757 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.QYowt830IP 2020-04-28T12:54:05.811 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.865 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:05.919 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.jTpKzafdcV 2020-04-28T12:54:05.919 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:05.972 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.jTpKzafdcV 2020-04-28T12:54:06.039 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.092 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.jTpKzafdcV 2020-04-28T12:54:06.215 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.jTpKzafdcV is 56B 2020-04-28T12:54:06.263 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.276 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.jTpKzafdcV 2020-04-28T12:54:06.329 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.382 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:06.435 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.AN0H1wYyOI 2020-04-28T12:54:06.436 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.489 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.AN0H1wYyOI 2020-04-28T12:54:06.631 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.644 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.AN0H1wYyOI 2020-04-28T12:54:06.768 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.AN0H1wYyOI is 56B 2020-04-28T12:54:06.815 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.828 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.AN0H1wYyOI 2020-04-28T12:54:06.887 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:06.941 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:06.995 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.aGg4H7d1Te 2020-04-28T12:54:06.995 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.048 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.aGg4H7d1Te 2020-04-28T12:54:07.116 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.170 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.aGg4H7d1Te 2020-04-28T12:54:07.298 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.aGg4H7d1Te is 56B 2020-04-28T12:54:07.347 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.360 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.aGg4H7d1Te 2020-04-28T12:54:07.413 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.466 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:07.521 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.TAlNzYqqfL 2020-04-28T12:54:07.521 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.574 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.TAlNzYqqfL 2020-04-28T12:54:07.641 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.695 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.TAlNzYqqfL 2020-04-28T12:54:07.819 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.TAlNzYqqfL is 56B 2020-04-28T12:54:07.876 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:07.889 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.TAlNzYqqfL 2020-04-28T12:54:07.962 DEBUG:teuthology.orchestra.remote:smithi176:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-28T12:54:08.027 DEBUG:teuthology.orchestra.remote:smithi084:/etc/ceph/ceph.client.1.keyring is 59B 2020-04-28T12:54:08.076 INFO:tasks.ceph:Adding keys to all mons... 2020-04-28T12:54:08.076 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.089 INFO:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:54:08.131 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.147 INFO:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:54:08.190 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2020-04-28T12:54:08.190 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBfJ6heDM6/JRAA2VHFtj/UC2SPIHr6eUcRKA== 2020-04-28T12:54:08.190 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2020-04-28T12:54:08.190 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBjJ6hehAUcLhAAOWmC1iw150nZxfMLscBkJA== 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBkJ6heocjSDxAA3aqUAbcEY/cygtTD/eS5ww== 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBkJ6heBM6WKhAAV2fCyGPgpL9rdHiqXQzfbQ== 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBlJ6heYmS4BxAAXMO9S3YeFENqd4bUCqozbQ== 2020-04-28T12:54:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBfJ6heDqPqLBAA3RE4UlzuRRDI3pmnvxwy9A== 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBpJ6he6HNMBhAA1VoPKwMGjWW9FW8BuIw3ZQ== 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBpJ6heffW0HxAAwuGatvtGn1rivl2YquruvQ== 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2020-04-28T12:54:08.192 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBqJ6he8XwDARAAfY5DmudOU+0dBeUZSGzP7A== 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBqJ6hej9q5GRAAzog1ASi3GBI/ReT7h0FW4A== 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBfJ6heDLePMhAATn152PLzxm3v6RF4GNC4MA== 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2020-04-28T12:54:08.193 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBfJ6hefsIRORAAjRy1EB/aLjE+raP0g/5pPQ== 2020-04-28T12:54:08.216 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2020-04-28T12:54:08.216 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBfJ6heDM6/JRAA2VHFtj/UC2SPIHr6eUcRKA== 2020-04-28T12:54:08.216 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2020-04-28T12:54:08.216 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBjJ6hehAUcLhAAOWmC1iw150nZxfMLscBkJA== 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBkJ6heocjSDxAA3aqUAbcEY/cygtTD/eS5ww== 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBkJ6heBM6WKhAAV2fCyGPgpL9rdHiqXQzfbQ== 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBlJ6heYmS4BxAAXMO9S3YeFENqd4bUCqozbQ== 2020-04-28T12:54:08.217 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBfJ6heDqPqLBAA3RE4UlzuRRDI3pmnvxwy9A== 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBpJ6he6HNMBhAA1VoPKwMGjWW9FW8BuIw3ZQ== 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBpJ6heffW0HxAAwuGatvtGn1rivl2YquruvQ== 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2020-04-28T12:54:08.218 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBqJ6he8XwDARAAfY5DmudOU+0dBeUZSGzP7A== 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBqJ6hej9q5GRAAzog1ASi3GBI/ReT7h0FW4A== 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBfJ6heDLePMhAATn152PLzxm3v6RF4GNC4MA== 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2020-04-28T12:54:08.219 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQBfJ6hefsIRORAAjRy1EB/aLjE+raP0g/5pPQ== 2020-04-28T12:54:08.220 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.247 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:54:08.289 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.305 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:54:08.398 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.412 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.454 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.469 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.559 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.573 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.615 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.630 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.718 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.731 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.774 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.787 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.874 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:08.887 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:08.929 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:08.942 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.030 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.043 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:54:09.085 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.098 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:54:09.186 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.199 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.241 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.254 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.342 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.355 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.397 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.410 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.496 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.510 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.552 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.565 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.654 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.667 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.709 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.722 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:54:09.809 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.822 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:54:09.864 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:09.881 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:54:09.972 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:09.986 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:54:10.028 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.042 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:54:10.132 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-28T12:54:10.132 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.145 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-28T12:54:10.219 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.272 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:54:10.365 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.379 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-28T12:54:10.446 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.499 INFO:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-28T12:54:10.565 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.619 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:54:10.716 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:10.729 INFO:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-28T12:54:10.796 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:10.811 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-28T12:54:10.892 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:10.946 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:54:11.040 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:11.053 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-28T12:54:11.120 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:11.173 INFO:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:11.215 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.229 INFO:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:54:11.285 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-28T12:54:11.286 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-28T12:54:11.286 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.339 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-28T12:54:11.382 INFO:tasks.ceph.mon.a:Started 2020-04-28T12:54:11.382 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-28T12:54:11.382 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.396 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-28T12:54:11.438 INFO:tasks.ceph.mon.c:Started 2020-04-28T12:54:11.438 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-28T12:54:11.438 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:11.451 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-28T12:54:11.493 INFO:tasks.ceph.mon.b:Started 2020-04-28T12:54:11.493 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-28T12:54:11.494 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-28T12:54:11.494 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.508 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-28T12:54:11.550 INFO:tasks.ceph.mgr.y:Started 2020-04-28T12:54:11.551 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-28T12:54:11.551 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:11.564 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-28T12:54:11.607 INFO:tasks.ceph.mgr.x:Started 2020-04-28T12:54:11.607 INFO:tasks.ceph:Setting crush tunables to default 2020-04-28T12:54:11.608 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.621 INFO:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd crush tunables default 2020-04-28T12:54:11.877 INFO:teuthology.orchestra.run.smithi176.stderr:adjusted tunables profile to default 2020-04-28T12:54:11.887 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-28T12:54:11.887 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:11.900 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:11.954 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.4q5UJrsg3u 2020-04-28T12:54:11.954 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.007 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.4q5UJrsg3u 2020-04-28T12:54:12.075 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.129 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.4q5UJrsg3u 2020-04-28T12:54:12.252 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.4q5UJrsg3u is 37B 2020-04-28T12:54:12.299 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.313 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.4q5UJrsg3u 2020-04-28T12:54:12.367 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.420 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:12.474 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.K02TEJEJ4l 2020-04-28T12:54:12.474 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.527 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.K02TEJEJ4l 2020-04-28T12:54:12.596 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.670 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.K02TEJEJ4l 2020-04-28T12:54:12.798 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.K02TEJEJ4l is 37B 2020-04-28T12:54:12.860 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:12.875 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.K02TEJEJ4l 2020-04-28T12:54:13.071 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.125 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:13.179 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Dru0XZEbfr 2020-04-28T12:54:13.179 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.232 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.Dru0XZEbfr 2020-04-28T12:54:13.300 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.354 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Dru0XZEbfr 2020-04-28T12:54:13.477 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Dru0XZEbfr is 37B 2020-04-28T12:54:13.524 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.537 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Dru0XZEbfr 2020-04-28T12:54:13.590 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.644 INFO:teuthology.orchestra.run.smithi176:> mktemp 2020-04-28T12:54:13.697 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.ufROdSwXV1 2020-04-28T12:54:13.698 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.751 INFO:teuthology.orchestra.run.smithi176:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.ufROdSwXV1 2020-04-28T12:54:13.818 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:13.871 INFO:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.ufROdSwXV1 2020-04-28T12:54:13.995 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.ufROdSwXV1 is 37B 2020-04-28T12:54:14.042 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:14.055 INFO:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.ufROdSwXV1 2020-04-28T12:54:14.109 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.122 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:14.176 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.olfIdHkWaf 2020-04-28T12:54:14.176 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.229 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.olfIdHkWaf 2020-04-28T12:54:14.297 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.350 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.olfIdHkWaf 2020-04-28T12:54:14.475 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.olfIdHkWaf is 37B 2020-04-28T12:54:14.527 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.541 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.olfIdHkWaf 2020-04-28T12:54:14.595 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.648 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:14.702 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.vNn6uShmjv 2020-04-28T12:54:14.702 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.755 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.vNn6uShmjv 2020-04-28T12:54:14.822 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:14.875 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.vNn6uShmjv 2020-04-28T12:54:14.998 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.vNn6uShmjv is 37B 2020-04-28T12:54:15.046 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.059 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.vNn6uShmjv 2020-04-28T12:54:15.111 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.164 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:15.217 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.M4oCUkkUmP 2020-04-28T12:54:15.218 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.271 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.M4oCUkkUmP 2020-04-28T12:54:15.338 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.391 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.M4oCUkkUmP 2020-04-28T12:54:15.514 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.M4oCUkkUmP is 37B 2020-04-28T12:54:15.562 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.577 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.M4oCUkkUmP 2020-04-28T12:54:15.629 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.682 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-28T12:54:15.735 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.9Q3O5nuJni 2020-04-28T12:54:15.736 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.789 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.9Q3O5nuJni 2020-04-28T12:54:15.857 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:15.910 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.9Q3O5nuJni 2020-04-28T12:54:16.033 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.9Q3O5nuJni is 37B 2020-04-28T12:54:16.080 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:16.094 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.9Q3O5nuJni 2020-04-28T12:54:16.146 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:16.199 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new fb7118dd-8f32-4868-9f2d-618466a3c055 0 2020-04-28T12:54:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:0 2020-04-28T12:54:16.522 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:16.534 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new aadb06f5-2a5d-410d-aadf-fcc48358eea1 1 2020-04-28T12:54:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:1 2020-04-28T12:54:16.858 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:16.871 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new a4559287-edef-4d5f-9d7d-276e5b0889a2 2 2020-04-28T12:54:17.182 INFO:teuthology.orchestra.run.smithi084.stdout:2 2020-04-28T12:54:17.190 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:17.203 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 6698d98f-866d-443b-a967-aecc442d71bc 3 2020-04-28T12:54:17.510 INFO:teuthology.orchestra.run.smithi084.stdout:3 2020-04-28T12:54:17.522 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:17.535 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 8fee827b-2a93-4fd1-81ec-3aeea75f5c35 4 2020-04-28T12:54:17.845 INFO:teuthology.orchestra.run.smithi084.stdout:4 2020-04-28T12:54:17.857 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:17.873 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 54fb1d35-7309-4b43-84e3-e320dab8c195 5 2020-04-28T12:54:18.183 INFO:teuthology.orchestra.run.smithi084.stdout:5 2020-04-28T12:54:18.195 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:18.209 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 48c831c5-8f4e-4f74-900a-0957a76f22f7 6 2020-04-28T12:54:18.519 INFO:teuthology.orchestra.run.smithi084.stdout:6 2020-04-28T12:54:18.531 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:18.544 INFO:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 6c59906a-5d39-4c78-94fd-ede8ec249583 7 2020-04-28T12:54:18.854 INFO:teuthology.orchestra.run.smithi084.stdout:7 2020-04-28T12:54:18.866 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-28T12:54:18.866 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:18.883 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-28T12:54:18.925 INFO:tasks.ceph.osd.0:Started 2020-04-28T12:54:18.925 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-28T12:54:18.926 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:18.942 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-28T12:54:18.985 INFO:tasks.ceph.osd.1:Started 2020-04-28T12:54:18.985 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-28T12:54:18.985 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:19.001 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-28T12:54:19.008 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:19.003+0000 7f5f6bb5fec0 -1 Falling back to public interface 2020-04-28T12:54:19.015 INFO:tasks.ceph.osd.2:Started 2020-04-28T12:54:19.016 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-28T12:54:19.016 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:19.020 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:19.015+0000 7f5f6bb5fec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.020 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:19.015+0000 7f5f6bb5fec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.020 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:19.015+0000 7f5f6bb5fec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.026 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:19.021+0000 7f5f6bb5fec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-28T12:54:19.035 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-28T12:54:19.069 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:19.064+0000 7fb0f5ecaec0 -1 Falling back to public interface 2020-04-28T12:54:19.070 INFO:tasks.ceph.osd.3:Started 2020-04-28T12:54:19.071 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-28T12:54:19.071 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:19.082 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:19.077+0000 7fb0f5ecaec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.082 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:19.077+0000 7fb0f5ecaec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.083 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:19.077+0000 7fb0f5ecaec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.085 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-28T12:54:19.087 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:19.082+0000 7fb0f5ecaec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-28T12:54:19.097 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:19.092+0000 7fb6eceeaec0 -1 Falling back to public interface 2020-04-28T12:54:19.111 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:19.106+0000 7fb6eceeaec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.111 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:19.106+0000 7fb6eceeaec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.111 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:19.106+0000 7fb6eceeaec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.116 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:19.111+0000 7fb6eceeaec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-28T12:54:19.128 INFO:tasks.ceph.osd.4:Started 2020-04-28T12:54:19.129 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-28T12:54:19.129 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:19.143 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-28T12:54:19.148 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:19.143+0000 7f13dbb09ec0 -1 Falling back to public interface 2020-04-28T12:54:19.163 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:19.158+0000 7f13dbb09ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.163 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:19.158+0000 7f13dbb09ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.163 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:19.158+0000 7f13dbb09ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.167 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:19.162+0000 7f13dbb09ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-28T12:54:19.185 INFO:tasks.ceph.osd.5:Started 2020-04-28T12:54:19.185 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-28T12:54:19.185 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:19.200 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-28T12:54:19.205 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:19.201+0000 7f40b2d92ec0 -1 Falling back to public interface 2020-04-28T12:54:19.206 INFO:tasks.ceph.osd.6:Started 2020-04-28T12:54:19.206 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-28T12:54:19.207 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-28T12:54:19.215 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:19.211+0000 7f40b2d92ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.216 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:19.211+0000 7f40b2d92ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.216 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:19.211+0000 7f40b2d92ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.221 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:19.217+0000 7f40b2d92ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-28T12:54:19.235 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-28T12:54:19.266 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:19.261+0000 7fba4a40aec0 -1 Falling back to public interface 2020-04-28T12:54:19.267 INFO:tasks.ceph.osd.7:Started 2020-04-28T12:54:19.267 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-28T12:54:19.277 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:19.272+0000 7fba4a40aec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.277 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:19.273+0000 7fba4a40aec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.277 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:19.273+0000 7fba4a40aec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.282 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:19.278+0000 7fba4a40aec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-28T12:54:19.289 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:19.285+0000 7fbdf68a5ec0 -1 Falling back to public interface 2020-04-28T12:54:19.304 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:19.299+0000 7fbdf68a5ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.304 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:19.300+0000 7fbdf68a5ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.305 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:19.300+0000 7fbdf68a5ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.309 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:19.305+0000 7fbdf68a5ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-28T12:54:19.348 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:19.344+0000 7f104a779ec0 -1 Falling back to public interface 2020-04-28T12:54:19.362 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:19.358+0000 7f104a779ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:54:19.362 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:19.358+0000 7f104a779ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.363 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:19.358+0000 7f104a779ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:54:19.367 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:19.363+0000 7f104a779ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-28T12:54:20.073 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:20.090 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:54:20.388 INFO:teuthology.misc.health.smithi176.stdout: 2020-04-28T12:54:20.388 INFO:teuthology.misc.health.smithi176.stdout:{"epoch":12,"fsid":"37ce95df-7d75-45e8-8120-5a8ac98fc95b","created":"2020-04-28T12:54:11.612739+0000","modified":"2020-04-28T12:54:19.849096+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:54:15.161863+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"fb7118dd-8f32-4868-9f2d-618466a3c055","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aadb06f5-2a5d-410d-aadf-fcc48358eea1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a4559287-edef-4d5f-9d7d-276e5b0889a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6698d98f-866d-443b-a967-aecc442d71bc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8fee827b-2a93-4fd1-81ec-3aeea75f5c35","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"54fb1d35-7309-4b43-84e3-e320dab8c195","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"48c831c5-8f4e-4f74-900a-0957a76f22f7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6c59906a-5d39-4c78-94fd-ede8ec249583","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:54:20.399 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-28T12:54:20.860 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T12:54:20.856+0000 7f102d519700 -1 osd.7 0 waiting for initial osdmap 2020-04-28T12:54:20.861 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-28T12:54:20.857+0000 7f4095b32700 -1 osd.4 0 waiting for initial osdmap 2020-04-28T12:54:20.866 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-28T12:54:20.862+0000 7fbdd9645700 -1 osd.6 0 waiting for initial osdmap 2020-04-28T12:54:20.866 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:54:20.861+0000 7f13be8a9700 -1 osd.3 0 waiting for initial osdmap 2020-04-28T12:54:20.867 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T12:54:20.861+0000 7fb0d8c6a700 -1 osd.1 0 waiting for initial osdmap 2020-04-28T12:54:20.867 INFO:tasks.ceph.osd.2.smithi176.stderr:2020-04-28T12:54:20.861+0000 7fb6cfc8a700 -1 osd.2 0 waiting for initial osdmap 2020-04-28T12:54:20.867 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T12:54:20.863+0000 7fba2d1aa700 -1 osd.5 0 waiting for initial osdmap 2020-04-28T12:54:20.868 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T12:54:20.862+0000 7f5f4e8ff700 -1 osd.0 0 waiting for initial osdmap 2020-04-28T12:54:27.206 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:27.223 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:54:27.517 INFO:teuthology.misc.health.smithi176.stdout: 2020-04-28T12:54:27.517 INFO:teuthology.misc.health.smithi176.stdout:{"epoch":16,"fsid":"37ce95df-7d75-45e8-8120-5a8ac98fc95b","created":"2020-04-28T12:54:11.612739+0000","modified":"2020-04-28T12:54:23.870586+0000","last_up_change":"2020-04-28T12:54:21.858785+0000","last_in_change":"2020-04-28T12:54:21.858785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:54:15.161863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"fb7118dd-8f32-4868-9f2d-618466a3c055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":23287},{"type":"v1","addr":"172.21.15.176:6803","nonce":23287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":23287},{"type":"v1","addr":"172.21.15.176:6805","nonce":23287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":23287},{"type":"v1","addr":"172.21.15.176:6809","nonce":23287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":23287},{"type":"v1","addr":"172.21.15.176:6807","nonce":23287}]},"public_addr":"172.21.15.176:6803/23287","cluster_addr":"172.21.15.176:6805/23287","heartbeat_back_addr":"172.21.15.176:6809/23287","heartbeat_front_addr":"172.21.15.176:6807/23287","state":["exists","up"]},{"osd":1,"uuid":"aadb06f5-2a5d-410d-aadf-fcc48358eea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":23439},{"type":"v1","addr":"172.21.15.176:6811","nonce":23439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":23439},{"type":"v1","addr":"172.21.15.176:6813","nonce":23439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":23439},{"type":"v1","addr":"172.21.15.176:6817","nonce":23439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":23439},{"type":"v1","addr":"172.21.15.176:6815","nonce":23439}]},"public_addr":"172.21.15.176:6811/23439","cluster_addr":"172.21.15.176:6813/23439","heartbeat_back_addr":"172.21.15.176:6817/23439","heartbeat_front_addr":"172.21.15.176:6815/23439","state":["exists","up"]},{"osd":2,"uuid":"a4559287-edef-4d5f-9d7d-276e5b0889a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":23465},{"type":"v1","addr":"172.21.15.176:6819","nonce":23465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":23465},{"type":"v1","addr":"172.21.15.176:6821","nonce":23465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":23465},{"type":"v1","addr":"172.21.15.176:6825","nonce":23465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":23465},{"type":"v1","addr":"172.21.15.176:6823","nonce":23465}]},"public_addr":"172.21.15.176:6819/23465","cluster_addr":"172.21.15.176:6821/23465","heartbeat_back_addr":"172.21.15.176:6825/23465","heartbeat_front_addr":"172.21.15.176:6823/23465","state":["exists","up"]},{"osd":3,"uuid":"6698d98f-866d-443b-a967-aecc442d71bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":23657},{"type":"v1","addr":"172.21.15.176:6827","nonce":23657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":23657},{"type":"v1","addr":"172.21.15.176:6829","nonce":23657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":23657},{"type":"v1","addr":"172.21.15.176:6833","nonce":23657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":23657},{"type":"v1","addr":"172.21.15.176:6831","nonce":23657}]},"public_addr":"172.21.15.176:6827/23657","cluster_addr":"172.21.15.176:6829/23657","heartbeat_back_addr":"172.21.15.176:6833/23657","heartbeat_front_addr":"172.21.15.176:6831/23657","state":["exists","up"]},{"osd":4,"uuid":"8fee827b-2a93-4fd1-81ec-3aeea75f5c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":23178},{"type":"v1","addr":"172.21.15.84:6801","nonce":23178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":23178},{"type":"v1","addr":"172.21.15.84:6803","nonce":23178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":23178},{"type":"v1","addr":"172.21.15.84:6807","nonce":23178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":23178},{"type":"v1","addr":"172.21.15.84:6805","nonce":23178}]},"public_addr":"172.21.15.84:6801/23178","cluster_addr":"172.21.15.84:6803/23178","heartbeat_back_addr":"172.21.15.84:6807/23178","heartbeat_front_addr":"172.21.15.84:6805/23178","state":["exists","up"]},{"osd":5,"uuid":"54fb1d35-7309-4b43-84e3-e320dab8c195","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":23339},{"type":"v1","addr":"172.21.15.84:6809","nonce":23339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":23339},{"type":"v1","addr":"172.21.15.84:6811","nonce":23339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":23339},{"type":"v1","addr":"172.21.15.84:6815","nonce":23339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":23339},{"type":"v1","addr":"172.21.15.84:6813","nonce":23339}]},"public_addr":"172.21.15.84:6809/23339","cluster_addr":"172.21.15.84:6811/23339","heartbeat_back_addr":"172.21.15.84:6815/23339","heartbeat_front_addr":"172.21.15.84:6813/23339","state":["exists","up"]},{"osd":6,"uuid":"48c831c5-8f4e-4f74-900a-0957a76f22f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":23358},{"type":"v1","addr":"172.21.15.84:6817","nonce":23358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":23358},{"type":"v1","addr":"172.21.15.84:6819","nonce":23358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":23358},{"type":"v1","addr":"172.21.15.84:6823","nonce":23358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":23358},{"type":"v1","addr":"172.21.15.84:6821","nonce":23358}]},"public_addr":"172.21.15.84:6817/23358","cluster_addr":"172.21.15.84:6819/23358","heartbeat_back_addr":"172.21.15.84:6823/23358","heartbeat_front_addr":"172.21.15.84:6821/23358","state":["exists","up"]},{"osd":7,"uuid":"6c59906a-5d39-4c78-94fd-ede8ec249583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":23557},{"type":"v1","addr":"172.21.15.84:6825","nonce":23557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":23557},{"type":"v1","addr":"172.21.15.84:6827","nonce":23557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":23557},{"type":"v1","addr":"172.21.15.84:6831","nonce":23557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":23557},{"type":"v1","addr":"172.21.15.84:6829","nonce":23557}]},"public_addr":"172.21.15.84:6825/23557","cluster_addr":"172.21.15.84:6827/23557","heartbeat_back_addr":"172.21.15.84:6831/23557","heartbeat_front_addr":"172.21.15.84:6829/23557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.040718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.037620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.141481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.179142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.257420+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.318678+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.273970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.379405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:54:27.527 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-28T12:54:27.527 INFO:tasks.ceph:Creating RBD pool 2020-04-28T12:54:27.527 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:27.541 INFO:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-28T12:54:28.609 INFO:teuthology.orchestra.run.smithi176.stderr:pool 'rbd' created 2020-04-28T12:54:28.621 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:28.638 INFO:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-28T12:54:29.616 INFO:teuthology.orchestra.run.smithi176.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-28T12:54:29.627 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-28T12:54:29.627 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:29.628 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-28T12:54:29.642 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:54:29.944 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:29.944 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":18,"fsid":"37ce95df-7d75-45e8-8120-5a8ac98fc95b","created":"2020-04-28T12:54:11.612739+0000","modified":"2020-04-28T12:54:29.600527+0000","last_up_change":"2020-04-28T12:54:21.858785+0000","last_in_change":"2020-04-28T12:54:21.858785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:54:15.161863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:54:27.842307+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fb7118dd-8f32-4868-9f2d-618466a3c055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":23287},{"type":"v1","addr":"172.21.15.176:6803","nonce":23287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":23287},{"type":"v1","addr":"172.21.15.176:6805","nonce":23287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":23287},{"type":"v1","addr":"172.21.15.176:6809","nonce":23287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":23287},{"type":"v1","addr":"172.21.15.176:6807","nonce":23287}]},"public_addr":"172.21.15.176:6803/23287","cluster_addr":"172.21.15.176:6805/23287","heartbeat_back_addr":"172.21.15.176:6809/23287","heartbeat_front_addr":"172.21.15.176:6807/23287","state":["exists","up"]},{"osd":1,"uuid":"aadb06f5-2a5d-410d-aadf-fcc48358eea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":23439},{"type":"v1","addr":"172.21.15.176:6811","nonce":23439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":23439},{"type":"v1","addr":"172.21.15.176:6813","nonce":23439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":23439},{"type":"v1","addr":"172.21.15.176:6817","nonce":23439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":23439},{"type":"v1","addr":"172.21.15.176:6815","nonce":23439}]},"public_addr":"172.21.15.176:6811/23439","cluster_addr":"172.21.15.176:6813/23439","heartbeat_back_addr":"172.21.15.176:6817/23439","heartbeat_front_addr":"172.21.15.176:6815/23439","state":["exists","up"]},{"osd":2,"uuid":"a4559287-edef-4d5f-9d7d-276e5b0889a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":23465},{"type":"v1","addr":"172.21.15.176:6819","nonce":23465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":23465},{"type":"v1","addr":"172.21.15.176:6821","nonce":23465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":23465},{"type":"v1","addr":"172.21.15.176:6825","nonce":23465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":23465},{"type":"v1","addr":"172.21.15.176:6823","nonce":23465}]},"public_addr":"172.21.15.176:6819/23465","cluster_addr":"172.21.15.176:6821/23465","heartbeat_back_addr":"172.21.15.176:6825/23465","heartbeat_front_addr":"172.21.15.176:6823/23465","state":["exists","up"]},{"osd":3,"uuid":"6698d98f-866d-443b-a967-aecc442d71bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":23657},{"type":"v1","addr":"172.21.15.176:6827","nonce":23657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":23657},{"type":"v1","addr":"172.21.15.176:6829","nonce":23657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":23657},{"type":"v1","addr":"172.21.15.176:6833","nonce":23657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":23657},{"type":"v1","addr":"172.21.15.176:6831","nonce":23657}]},"public_addr":"172.21.15.176:6827/23657","cluster_addr":"172.21.15.176:6829/23657","heartbeat_back_addr":"172.21.15.176:6833/23657","heartbeat_front_addr":"172.21.15.176:6831/23657","state":["exists","up"]},{"osd":4,"uuid":"8fee827b-2a93-4fd1-81ec-3aeea75f5c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":23178},{"type":"v1","addr":"172.21.15.84:6801","nonce":23178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":23178},{"type":"v1","addr":"172.21.15.84:6803","nonce":23178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":23178},{"type":"v1","addr":"172.21.15.84:6807","nonce":23178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":23178},{"type":"v1","addr":"172.21.15.84:6805","nonce":23178}]},"public_addr":"172.21.15.84:6801/23178","cluster_addr":"172.21.15.84:6803/23178","heartbeat_back_addr":"172.21.15.84:6807/23178","heartbeat_front_addr":"172.21.15.84:6805/23178","state":["exists","up"]},{"osd":5,"uuid":"54fb1d35-7309-4b43-84e3-e320dab8c195","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":23339},{"type":"v1","addr":"172.21.15.84:6809","nonce":23339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":23339},{"type":"v1","addr":"172.21.15.84:6811","nonce":23339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":23339},{"type":"v1","addr":"172.21.15.84:6815","nonce":23339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":23339},{"type":"v1","addr":"172.21.15.84:6813","nonce":23339}]},"public_addr":"172.21.15.84:6809/23339","cluster_addr":"172.21.15.84:6811/23339","heartbeat_back_addr":"172.21.15.84:6815/23339","heartbeat_front_addr":"172.21.15.84:6813/23339","state":["exists","up"]},{"osd":6,"uuid":"48c831c5-8f4e-4f74-900a-0957a76f22f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":23358},{"type":"v1","addr":"172.21.15.84:6817","nonce":23358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":23358},{"type":"v1","addr":"172.21.15.84:6819","nonce":23358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":23358},{"type":"v1","addr":"172.21.15.84:6823","nonce":23358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":23358},{"type":"v1","addr":"172.21.15.84:6821","nonce":23358}]},"public_addr":"172.21.15.84:6817/23358","cluster_addr":"172.21.15.84:6819/23358","heartbeat_back_addr":"172.21.15.84:6823/23358","heartbeat_front_addr":"172.21.15.84:6821/23358","state":["exists","up"]},{"osd":7,"uuid":"6c59906a-5d39-4c78-94fd-ede8ec249583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":23557},{"type":"v1","addr":"172.21.15.84:6825","nonce":23557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":23557},{"type":"v1","addr":"172.21.15.84:6827","nonce":23557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":23557},{"type":"v1","addr":"172.21.15.84:6831","nonce":23557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":23557},{"type":"v1","addr":"172.21.15.84:6829","nonce":23557}]},"public_addr":"172.21.15.84:6825/23557","cluster_addr":"172.21.15.84:6827/23557","heartbeat_back_addr":"172.21.15.84:6831/23557","heartbeat_front_addr":"172.21.15.84:6829/23557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.040718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.037620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.141481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.179142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.257420+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.318678+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.273970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.379405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:54:29.955 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:54:15.161863+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:54:27.842307+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-28T12:54:29.956 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:29.969 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-28T12:54:30.264 INFO:teuthology.orchestra.run.smithi176.stdout:pg_num: 1 2020-04-28T12:54:30.276 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:30.291 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-28T12:54:30.586 INFO:teuthology.orchestra.run.smithi176.stdout:pg_num: 8 2020-04-28T12:54:30.597 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-28T12:54:30.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-28T12:54:30.597 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:30.610 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-28T12:54:30.947 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:30.958 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":4,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":22435},{"type":"v1","addr":"172.21.15.176:6801","nonce":22435}]},"active_addr":"172.21.15.176:6801/22435","active_change":"2020-04-28T12:54:14.735890+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2516324332}]},{"addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1849915545}]},{"addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2566523618}]}]}} 2020-04-28T12:54:30.965 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-28T12:54:30.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-28T12:54:30.965 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:30.979 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:54:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:31.271 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":19,"fsid":"37ce95df-7d75-45e8-8120-5a8ac98fc95b","created":"2020-04-28T12:54:11.612739+0000","modified":"2020-04-28T12:54:30.606857+0000","last_up_change":"2020-04-28T12:54:21.858785+0000","last_in_change":"2020-04-28T12:54:21.858785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:54:15.161863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:54:27.842307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fb7118dd-8f32-4868-9f2d-618466a3c055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":23287},{"type":"v1","addr":"172.21.15.176:6803","nonce":23287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":23287},{"type":"v1","addr":"172.21.15.176:6805","nonce":23287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":23287},{"type":"v1","addr":"172.21.15.176:6809","nonce":23287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":23287},{"type":"v1","addr":"172.21.15.176:6807","nonce":23287}]},"public_addr":"172.21.15.176:6803/23287","cluster_addr":"172.21.15.176:6805/23287","heartbeat_back_addr":"172.21.15.176:6809/23287","heartbeat_front_addr":"172.21.15.176:6807/23287","state":["exists","up"]},{"osd":1,"uuid":"aadb06f5-2a5d-410d-aadf-fcc48358eea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":23439},{"type":"v1","addr":"172.21.15.176:6811","nonce":23439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":23439},{"type":"v1","addr":"172.21.15.176:6813","nonce":23439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":23439},{"type":"v1","addr":"172.21.15.176:6817","nonce":23439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":23439},{"type":"v1","addr":"172.21.15.176:6815","nonce":23439}]},"public_addr":"172.21.15.176:6811/23439","cluster_addr":"172.21.15.176:6813/23439","heartbeat_back_addr":"172.21.15.176:6817/23439","heartbeat_front_addr":"172.21.15.176:6815/23439","state":["exists","up"]},{"osd":2,"uuid":"a4559287-edef-4d5f-9d7d-276e5b0889a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":23465},{"type":"v1","addr":"172.21.15.176:6819","nonce":23465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":23465},{"type":"v1","addr":"172.21.15.176:6821","nonce":23465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":23465},{"type":"v1","addr":"172.21.15.176:6825","nonce":23465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":23465},{"type":"v1","addr":"172.21.15.176:6823","nonce":23465}]},"public_addr":"172.21.15.176:6819/23465","cluster_addr":"172.21.15.176:6821/23465","heartbeat_back_addr":"172.21.15.176:6825/23465","heartbeat_front_addr":"172.21.15.176:6823/23465","state":["exists","up"]},{"osd":3,"uuid":"6698d98f-866d-443b-a967-aecc442d71bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":23657},{"type":"v1","addr":"172.21.15.176:6827","nonce":23657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":23657},{"type":"v1","addr":"172.21.15.176:6829","nonce":23657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":23657},{"type":"v1","addr":"172.21.15.176:6833","nonce":23657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":23657},{"type":"v1","addr":"172.21.15.176:6831","nonce":23657}]},"public_addr":"172.21.15.176:6827/23657","cluster_addr":"172.21.15.176:6829/23657","heartbeat_back_addr":"172.21.15.176:6833/23657","heartbeat_front_addr":"172.21.15.176:6831/23657","state":["exists","up"]},{"osd":4,"uuid":"8fee827b-2a93-4fd1-81ec-3aeea75f5c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":23178},{"type":"v1","addr":"172.21.15.84:6801","nonce":23178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":23178},{"type":"v1","addr":"172.21.15.84:6803","nonce":23178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":23178},{"type":"v1","addr":"172.21.15.84:6807","nonce":23178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":23178},{"type":"v1","addr":"172.21.15.84:6805","nonce":23178}]},"public_addr":"172.21.15.84:6801/23178","cluster_addr":"172.21.15.84:6803/23178","heartbeat_back_addr":"172.21.15.84:6807/23178","heartbeat_front_addr":"172.21.15.84:6805/23178","state":["exists","up"]},{"osd":5,"uuid":"54fb1d35-7309-4b43-84e3-e320dab8c195","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":23339},{"type":"v1","addr":"172.21.15.84:6809","nonce":23339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":23339},{"type":"v1","addr":"172.21.15.84:6811","nonce":23339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":23339},{"type":"v1","addr":"172.21.15.84:6815","nonce":23339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":23339},{"type":"v1","addr":"172.21.15.84:6813","nonce":23339}]},"public_addr":"172.21.15.84:6809/23339","cluster_addr":"172.21.15.84:6811/23339","heartbeat_back_addr":"172.21.15.84:6815/23339","heartbeat_front_addr":"172.21.15.84:6813/23339","state":["exists","up"]},{"osd":6,"uuid":"48c831c5-8f4e-4f74-900a-0957a76f22f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":23358},{"type":"v1","addr":"172.21.15.84:6817","nonce":23358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":23358},{"type":"v1","addr":"172.21.15.84:6819","nonce":23358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":23358},{"type":"v1","addr":"172.21.15.84:6823","nonce":23358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":23358},{"type":"v1","addr":"172.21.15.84:6821","nonce":23358}]},"public_addr":"172.21.15.84:6817/23358","cluster_addr":"172.21.15.84:6819/23358","heartbeat_back_addr":"172.21.15.84:6823/23358","heartbeat_front_addr":"172.21.15.84:6821/23358","state":["exists","up"]},{"osd":7,"uuid":"6c59906a-5d39-4c78-94fd-ede8ec249583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":23557},{"type":"v1","addr":"172.21.15.84:6825","nonce":23557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":23557},{"type":"v1","addr":"172.21.15.84:6827","nonce":23557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":23557},{"type":"v1","addr":"172.21.15.84:6831","nonce":23557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":23557},{"type":"v1","addr":"172.21.15.84:6829","nonce":23557}]},"public_addr":"172.21.15.84:6825/23557","cluster_addr":"172.21.15.84:6827/23557","heartbeat_back_addr":"172.21.15.84:6831/23557","heartbeat_front_addr":"172.21.15.84:6829/23557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.040718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.037620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.141481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.179142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.257420+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.318678+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.273970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.379405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:54:31.282 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-28T12:54:31.283 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:31.295 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:54:31.589 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:31.590 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":19,"fsid":"37ce95df-7d75-45e8-8120-5a8ac98fc95b","created":"2020-04-28T12:54:11.612739+0000","modified":"2020-04-28T12:54:30.606857+0000","last_up_change":"2020-04-28T12:54:21.858785+0000","last_in_change":"2020-04-28T12:54:21.858785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:54:15.161863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:54:27.842307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fb7118dd-8f32-4868-9f2d-618466a3c055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":23287},{"type":"v1","addr":"172.21.15.176:6803","nonce":23287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":23287},{"type":"v1","addr":"172.21.15.176:6805","nonce":23287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":23287},{"type":"v1","addr":"172.21.15.176:6809","nonce":23287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":23287},{"type":"v1","addr":"172.21.15.176:6807","nonce":23287}]},"public_addr":"172.21.15.176:6803/23287","cluster_addr":"172.21.15.176:6805/23287","heartbeat_back_addr":"172.21.15.176:6809/23287","heartbeat_front_addr":"172.21.15.176:6807/23287","state":["exists","up"]},{"osd":1,"uuid":"aadb06f5-2a5d-410d-aadf-fcc48358eea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":23439},{"type":"v1","addr":"172.21.15.176:6811","nonce":23439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":23439},{"type":"v1","addr":"172.21.15.176:6813","nonce":23439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":23439},{"type":"v1","addr":"172.21.15.176:6817","nonce":23439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":23439},{"type":"v1","addr":"172.21.15.176:6815","nonce":23439}]},"public_addr":"172.21.15.176:6811/23439","cluster_addr":"172.21.15.176:6813/23439","heartbeat_back_addr":"172.21.15.176:6817/23439","heartbeat_front_addr":"172.21.15.176:6815/23439","state":["exists","up"]},{"osd":2,"uuid":"a4559287-edef-4d5f-9d7d-276e5b0889a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":23465},{"type":"v1","addr":"172.21.15.176:6819","nonce":23465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":23465},{"type":"v1","addr":"172.21.15.176:6821","nonce":23465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":23465},{"type":"v1","addr":"172.21.15.176:6825","nonce":23465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":23465},{"type":"v1","addr":"172.21.15.176:6823","nonce":23465}]},"public_addr":"172.21.15.176:6819/23465","cluster_addr":"172.21.15.176:6821/23465","heartbeat_back_addr":"172.21.15.176:6825/23465","heartbeat_front_addr":"172.21.15.176:6823/23465","state":["exists","up"]},{"osd":3,"uuid":"6698d98f-866d-443b-a967-aecc442d71bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":23657},{"type":"v1","addr":"172.21.15.176:6827","nonce":23657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":23657},{"type":"v1","addr":"172.21.15.176:6829","nonce":23657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":23657},{"type":"v1","addr":"172.21.15.176:6833","nonce":23657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":23657},{"type":"v1","addr":"172.21.15.176:6831","nonce":23657}]},"public_addr":"172.21.15.176:6827/23657","cluster_addr":"172.21.15.176:6829/23657","heartbeat_back_addr":"172.21.15.176:6833/23657","heartbeat_front_addr":"172.21.15.176:6831/23657","state":["exists","up"]},{"osd":4,"uuid":"8fee827b-2a93-4fd1-81ec-3aeea75f5c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":23178},{"type":"v1","addr":"172.21.15.84:6801","nonce":23178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":23178},{"type":"v1","addr":"172.21.15.84:6803","nonce":23178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":23178},{"type":"v1","addr":"172.21.15.84:6807","nonce":23178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":23178},{"type":"v1","addr":"172.21.15.84:6805","nonce":23178}]},"public_addr":"172.21.15.84:6801/23178","cluster_addr":"172.21.15.84:6803/23178","heartbeat_back_addr":"172.21.15.84:6807/23178","heartbeat_front_addr":"172.21.15.84:6805/23178","state":["exists","up"]},{"osd":5,"uuid":"54fb1d35-7309-4b43-84e3-e320dab8c195","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":23339},{"type":"v1","addr":"172.21.15.84:6809","nonce":23339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":23339},{"type":"v1","addr":"172.21.15.84:6811","nonce":23339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":23339},{"type":"v1","addr":"172.21.15.84:6815","nonce":23339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":23339},{"type":"v1","addr":"172.21.15.84:6813","nonce":23339}]},"public_addr":"172.21.15.84:6809/23339","cluster_addr":"172.21.15.84:6811/23339","heartbeat_back_addr":"172.21.15.84:6815/23339","heartbeat_front_addr":"172.21.15.84:6813/23339","state":["exists","up"]},{"osd":6,"uuid":"48c831c5-8f4e-4f74-900a-0957a76f22f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":23358},{"type":"v1","addr":"172.21.15.84:6817","nonce":23358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":23358},{"type":"v1","addr":"172.21.15.84:6819","nonce":23358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":23358},{"type":"v1","addr":"172.21.15.84:6823","nonce":23358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":23358},{"type":"v1","addr":"172.21.15.84:6821","nonce":23358}]},"public_addr":"172.21.15.84:6817/23358","cluster_addr":"172.21.15.84:6819/23358","heartbeat_back_addr":"172.21.15.84:6823/23358","heartbeat_front_addr":"172.21.15.84:6821/23358","state":["exists","up"]},{"osd":7,"uuid":"6c59906a-5d39-4c78-94fd-ede8ec249583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":23557},{"type":"v1","addr":"172.21.15.84:6825","nonce":23557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":23557},{"type":"v1","addr":"172.21.15.84:6827","nonce":23557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":23557},{"type":"v1","addr":"172.21.15.84:6831","nonce":23557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":23557},{"type":"v1","addr":"172.21.15.84:6829","nonce":23557}]},"public_addr":"172.21.15.84:6825/23557","cluster_addr":"172.21.15.84:6827/23557","heartbeat_back_addr":"172.21.15.84:6831/23557","heartbeat_front_addr":"172.21.15.84:6829/23557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.040718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.037620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.141481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.179142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.257420+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.318678+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.273970+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:54:20.379405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:54:31.601 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:31.614 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-28T12:54:31.792 INFO:teuthology.orchestra.run.smithi176.stdout:60129542147 2020-04-28T12:54:31.793 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:31.806 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-28T12:54:31.984 INFO:teuthology.orchestra.run.smithi176.stdout:60129542148 2020-04-28T12:54:31.984 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:31.997 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-28T12:54:32.176 INFO:teuthology.orchestra.run.smithi176.stdout:60129542149 2020-04-28T12:54:32.177 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:32.190 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-28T12:54:32.371 INFO:teuthology.orchestra.run.smithi176.stdout:60129542149 2020-04-28T12:54:32.371 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:32.386 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-28T12:54:32.565 INFO:teuthology.orchestra.run.smithi176.stdout:60129542147 2020-04-28T12:54:32.566 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:32.579 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-28T12:54:32.759 INFO:teuthology.orchestra.run.smithi176.stdout:60129542147 2020-04-28T12:54:32.760 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:32.779 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-28T12:54:32.953 INFO:teuthology.orchestra.run.smithi176.stdout:60129542150 2020-04-28T12:54:32.954 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:32.967 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-28T12:54:33.148 INFO:teuthology.orchestra.run.smithi176.stdout:60129542149 2020-04-28T12:54:33.148 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:33.162 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:54:33.456 INFO:teuthology.orchestra.run.smithi176.stdout:60129542146 2020-04-28T12:54:33.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2020-04-28T12:54:34.473 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:34.490 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:54:34.791 INFO:teuthology.orchestra.run.smithi176.stdout:60129542147 2020-04-28T12:54:34.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2020-04-28T12:54:34.803 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:34.816 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-28T12:54:35.113 INFO:teuthology.orchestra.run.smithi176.stdout:60129542148 2020-04-28T12:54:35.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2020-04-28T12:54:35.124 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:35.137 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-28T12:54:35.429 INFO:teuthology.orchestra.run.smithi176.stdout:60129542149 2020-04-28T12:54:35.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2020-04-28T12:54:35.440 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:35.453 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-28T12:54:35.748 INFO:teuthology.orchestra.run.smithi176.stdout:60129542150 2020-04-28T12:54:35.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.3 2020-04-28T12:54:35.760 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:35.773 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-28T12:54:36.066 INFO:teuthology.orchestra.run.smithi176.stdout:60129542148 2020-04-28T12:54:36.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.4 2020-04-28T12:54:36.077 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:36.091 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-28T12:54:36.387 INFO:teuthology.orchestra.run.smithi176.stdout:60129542148 2020-04-28T12:54:36.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.5 2020-04-28T12:54:36.398 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:36.411 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-28T12:54:36.713 INFO:teuthology.orchestra.run.smithi176.stdout:60129542150 2020-04-28T12:54:36.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2020-04-28T12:54:36.725 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:36.738 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-28T12:54:37.030 INFO:teuthology.orchestra.run.smithi176.stdout:60129542149 2020-04-28T12:54:37.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2020-04-28T12:54:37.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-28T12:54:37.042 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:37.055 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:54:37.347 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:37.348 INFO:teuthology.orchestra.run.smithi176.stderr:dumped all 2020-04-28T12:54:37.356 INFO:teuthology.orchestra.run.smithi176.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:54:36.742837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369632,"kb_used_data":743225760,"kb_used_omap":334,"kb_used_meta":0,"kb_avail":743225408,"statfs":{"total":767585320960,"available":761062817792,"internally_reserved":360448,"allocated":761063178240,"data_stored":761063178240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":342439,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001406"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.831543+0000","last_change":"2020-04-28T12:54:29.830851+0000","last_active":"2020-04-28T12:54:29.831543+0000","last_peered":"2020-04-28T12:54:29.831543+0000","last_clean":"2020-04-28T12:54:29.831543+0000","last_became_active":"2020-04-28T12:54:29.830425+0000","last_became_peered":"2020-04-28T12:54:29.830425+0000","last_unstale":"2020-04-28T12:54:29.831543+0000","last_undegraded":"2020-04-28T12:54:29.831543+0000","last_fullsized":"2020-04-28T12:54:29.831543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.830894+0000","last_change":"2020-04-28T12:54:29.830733+0000","last_active":"2020-04-28T12:54:29.830894+0000","last_peered":"2020-04-28T12:54:29.830894+0000","last_clean":"2020-04-28T12:54:29.830894+0000","last_became_active":"2020-04-28T12:54:29.830340+0000","last_became_peered":"2020-04-28T12:54:29.830340+0000","last_unstale":"2020-04-28T12:54:29.830894+0000","last_undegraded":"2020-04-28T12:54:29.830894+0000","last_fullsized":"2020-04-28T12:54:29.830894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.612303+0000","last_change":"2020-04-28T12:54:29.612107+0000","last_active":"2020-04-28T12:54:29.612303+0000","last_peered":"2020-04-28T12:54:29.612303+0000","last_clean":"2020-04-28T12:54:29.612303+0000","last_became_active":"2020-04-28T12:54:29.611759+0000","last_became_peered":"2020-04-28T12:54:29.611759+0000","last_unstale":"2020-04-28T12:54:29.612303+0000","last_undegraded":"2020-04-28T12:54:29.612303+0000","last_fullsized":"2020-04-28T12:54:29.612303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.613670+0000","last_change":"2020-04-28T12:54:29.613517+0000","last_active":"2020-04-28T12:54:29.613670+0000","last_peered":"2020-04-28T12:54:29.613670+0000","last_clean":"2020-04-28T12:54:29.613670+0000","last_became_active":"2020-04-28T12:54:29.613138+0000","last_became_peered":"2020-04-28T12:54:29.613138+0000","last_unstale":"2020-04-28T12:54:29.613670+0000","last_undegraded":"2020-04-28T12:54:29.613670+0000","last_fullsized":"2020-04-28T12:54:29.613670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.608037+0000","last_change":"2020-04-28T12:54:22.869719+0000","last_active":"2020-04-28T12:54:29.608037+0000","last_peered":"2020-04-28T12:54:29.608037+0000","last_clean":"2020-04-28T12:54:29.608037+0000","last_became_active":"2020-04-28T12:54:22.869439+0000","last_became_peered":"2020-04-28T12:54:22.869439+0000","last_unstale":"2020-04-28T12:54:29.608037+0000","last_undegraded":"2020-04-28T12:54:29.608037+0000","last_fullsized":"2020-04-28T12:54:29.608037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:15.789854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:15.789854+0000","last_clean_scrub_stamp":"2020-04-28T12:54:15.789854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.832621+0000","last_change":"2020-04-28T12:54:29.832481+0000","last_active":"2020-04-28T12:54:29.832621+0000","last_peered":"2020-04-28T12:54:29.832621+0000","last_clean":"2020-04-28T12:54:29.832621+0000","last_became_active":"2020-04-28T12:54:29.832129+0000","last_became_peered":"2020-04-28T12:54:29.832129+0000","last_unstale":"2020-04-28T12:54:29.832621+0000","last_undegraded":"2020-04-28T12:54:29.832621+0000","last_fullsized":"2020-04-28T12:54:29.832621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.613062+0000","last_change":"2020-04-28T12:54:29.612408+0000","last_active":"2020-04-28T12:54:29.613062+0000","last_peered":"2020-04-28T12:54:29.613062+0000","last_clean":"2020-04-28T12:54:29.613062+0000","last_became_active":"2020-04-28T12:54:29.611961+0000","last_became_peered":"2020-04-28T12:54:29.611961+0000","last_unstale":"2020-04-28T12:54:29.613062+0000","last_undegraded":"2020-04-28T12:54:29.613062+0000","last_fullsized":"2020-04-28T12:54:29.613062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.612509+0000","last_change":"2020-04-28T12:54:29.612387+0000","last_active":"2020-04-28T12:54:29.612509+0000","last_peered":"2020-04-28T12:54:29.612509+0000","last_clean":"2020-04-28T12:54:29.612509+0000","last_became_active":"2020-04-28T12:54:29.611992+0000","last_became_peered":"2020-04-28T12:54:29.611992+0000","last_unstale":"2020-04-28T12:54:29.612509+0000","last_undegraded":"2020-04-28T12:54:29.612509+0000","last_fullsized":"2020-04-28T12:54:29.612509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.614923+0000","last_change":"2020-04-28T12:54:29.614737+0000","last_active":"2020-04-28T12:54:29.614923+0000","last_peered":"2020-04-28T12:54:29.614923+0000","last_clean":"2020-04-28T12:54:29.614923+0000","last_became_active":"2020-04-28T12:54:29.614305+0000","last_became_peered":"2020-04-28T12:54:29.614305+0000","last_unstale":"2020-04-28T12:54:29.614923+0000","last_undegraded":"2020-04-28T12:54:29.614923+0000","last_fullsized":"2020-04-28T12:54:29.614923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796188,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903192,"statfs":{"total":95948165120,"available":95132868608,"internally_reserved":28672,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33033,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796208,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903172,"statfs":{"total":95948165120,"available":95132848128,"internally_reserved":49152,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38039,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796176,"kb_used_data":92903220,"kb_used_omap":43,"kb_used_meta":0,"kb_avail":92903204,"statfs":{"total":95948165120,"available":95132880896,"internally_reserved":16384,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44634,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796208,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903172,"statfs":{"total":95948165120,"available":95132848128,"internally_reserved":49152,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38039,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796192,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903188,"statfs":{"total":95948165120,"available":95132864512,"internally_reserved":32768,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32989,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796236,"kb_used_data":92903220,"kb_used_omap":56,"kb_used_meta":0,"kb_avail":92903144,"statfs":{"total":95948165120,"available":95132819456,"internally_reserved":77824,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57838,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796220,"kb_used_data":92903220,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903160,"statfs":{"total":95948165120,"available":95132835840,"internally_reserved":61440,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59784,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]}]}]}} 2020-04-28T12:54:37.358 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:37.372 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:54:37.663 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:37.664 INFO:teuthology.orchestra.run.smithi176.stderr:dumped all 2020-04-28T12:54:37.674 INFO:teuthology.orchestra.run.smithi176.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:54:36.742837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369632,"kb_used_data":743225760,"kb_used_omap":334,"kb_used_meta":0,"kb_avail":743225408,"statfs":{"total":767585320960,"available":761062817792,"internally_reserved":360448,"allocated":761063178240,"data_stored":761063178240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":342439,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001406"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.831543+0000","last_change":"2020-04-28T12:54:29.830851+0000","last_active":"2020-04-28T12:54:29.831543+0000","last_peered":"2020-04-28T12:54:29.831543+0000","last_clean":"2020-04-28T12:54:29.831543+0000","last_became_active":"2020-04-28T12:54:29.830425+0000","last_became_peered":"2020-04-28T12:54:29.830425+0000","last_unstale":"2020-04-28T12:54:29.831543+0000","last_undegraded":"2020-04-28T12:54:29.831543+0000","last_fullsized":"2020-04-28T12:54:29.831543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.830894+0000","last_change":"2020-04-28T12:54:29.830733+0000","last_active":"2020-04-28T12:54:29.830894+0000","last_peered":"2020-04-28T12:54:29.830894+0000","last_clean":"2020-04-28T12:54:29.830894+0000","last_became_active":"2020-04-28T12:54:29.830340+0000","last_became_peered":"2020-04-28T12:54:29.830340+0000","last_unstale":"2020-04-28T12:54:29.830894+0000","last_undegraded":"2020-04-28T12:54:29.830894+0000","last_fullsized":"2020-04-28T12:54:29.830894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.612303+0000","last_change":"2020-04-28T12:54:29.612107+0000","last_active":"2020-04-28T12:54:29.612303+0000","last_peered":"2020-04-28T12:54:29.612303+0000","last_clean":"2020-04-28T12:54:29.612303+0000","last_became_active":"2020-04-28T12:54:29.611759+0000","last_became_peered":"2020-04-28T12:54:29.611759+0000","last_unstale":"2020-04-28T12:54:29.612303+0000","last_undegraded":"2020-04-28T12:54:29.612303+0000","last_fullsized":"2020-04-28T12:54:29.612303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.613670+0000","last_change":"2020-04-28T12:54:29.613517+0000","last_active":"2020-04-28T12:54:29.613670+0000","last_peered":"2020-04-28T12:54:29.613670+0000","last_clean":"2020-04-28T12:54:29.613670+0000","last_became_active":"2020-04-28T12:54:29.613138+0000","last_became_peered":"2020-04-28T12:54:29.613138+0000","last_unstale":"2020-04-28T12:54:29.613670+0000","last_undegraded":"2020-04-28T12:54:29.613670+0000","last_fullsized":"2020-04-28T12:54:29.613670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.608037+0000","last_change":"2020-04-28T12:54:22.869719+0000","last_active":"2020-04-28T12:54:29.608037+0000","last_peered":"2020-04-28T12:54:29.608037+0000","last_clean":"2020-04-28T12:54:29.608037+0000","last_became_active":"2020-04-28T12:54:22.869439+0000","last_became_peered":"2020-04-28T12:54:22.869439+0000","last_unstale":"2020-04-28T12:54:29.608037+0000","last_undegraded":"2020-04-28T12:54:29.608037+0000","last_fullsized":"2020-04-28T12:54:29.608037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:15.789854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:15.789854+0000","last_clean_scrub_stamp":"2020-04-28T12:54:15.789854+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.832621+0000","last_change":"2020-04-28T12:54:29.832481+0000","last_active":"2020-04-28T12:54:29.832621+0000","last_peered":"2020-04-28T12:54:29.832621+0000","last_clean":"2020-04-28T12:54:29.832621+0000","last_became_active":"2020-04-28T12:54:29.832129+0000","last_became_peered":"2020-04-28T12:54:29.832129+0000","last_unstale":"2020-04-28T12:54:29.832621+0000","last_undegraded":"2020-04-28T12:54:29.832621+0000","last_fullsized":"2020-04-28T12:54:29.832621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.613062+0000","last_change":"2020-04-28T12:54:29.612408+0000","last_active":"2020-04-28T12:54:29.613062+0000","last_peered":"2020-04-28T12:54:29.613062+0000","last_clean":"2020-04-28T12:54:29.613062+0000","last_became_active":"2020-04-28T12:54:29.611961+0000","last_became_peered":"2020-04-28T12:54:29.611961+0000","last_unstale":"2020-04-28T12:54:29.613062+0000","last_undegraded":"2020-04-28T12:54:29.613062+0000","last_fullsized":"2020-04-28T12:54:29.613062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.612509+0000","last_change":"2020-04-28T12:54:29.612387+0000","last_active":"2020-04-28T12:54:29.612509+0000","last_peered":"2020-04-28T12:54:29.612509+0000","last_clean":"2020-04-28T12:54:29.612509+0000","last_became_active":"2020-04-28T12:54:29.611992+0000","last_became_peered":"2020-04-28T12:54:29.611992+0000","last_unstale":"2020-04-28T12:54:29.612509+0000","last_undegraded":"2020-04-28T12:54:29.612509+0000","last_fullsized":"2020-04-28T12:54:29.612509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:54:29.614923+0000","last_change":"2020-04-28T12:54:29.614737+0000","last_active":"2020-04-28T12:54:29.614923+0000","last_peered":"2020-04-28T12:54:29.614923+0000","last_clean":"2020-04-28T12:54:29.614923+0000","last_became_active":"2020-04-28T12:54:29.614305+0000","last_became_peered":"2020-04-28T12:54:29.614305+0000","last_unstale":"2020-04-28T12:54:29.614923+0000","last_undegraded":"2020-04-28T12:54:29.614923+0000","last_fullsized":"2020-04-28T12:54:29.614923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:54:28.595855+0000","last_clean_scrub_stamp":"2020-04-28T12:54:28.595855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796188,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903192,"statfs":{"total":95948165120,"available":95132868608,"internally_reserved":28672,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33033,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796208,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903172,"statfs":{"total":95948165120,"available":95132848128,"internally_reserved":49152,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38039,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796176,"kb_used_data":92903220,"kb_used_omap":43,"kb_used_meta":0,"kb_avail":92903204,"statfs":{"total":95948165120,"available":95132880896,"internally_reserved":16384,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44634,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796208,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903172,"statfs":{"total":95948165120,"available":95132848128,"internally_reserved":49152,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38039,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796192,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903188,"statfs":{"total":95948165120,"available":95132864512,"internally_reserved":32768,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32989,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796236,"kb_used_data":92903220,"kb_used_omap":56,"kb_used_meta":0,"kb_avail":92903144,"statfs":{"total":95948165120,"available":95132819456,"internally_reserved":77824,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57838,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796220,"kb_used_data":92903220,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903160,"statfs":{"total":95948165120,"available":95132835840,"internally_reserved":61440,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59784,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]}]}]}} 2020-04-28T12:54:37.676 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-28T12:54:37.676 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-28T12:54:37.677 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-28T12:54:37.677 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:37.690 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-28T12:54:38.031 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:54:38.043 INFO:teuthology.orchestra.run.smithi176.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-28T12:54:38.043 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-28T12:54:38.043 INFO:teuthology.run_tasks:Running task openssl_keys... 2020-04-28T12:54:38.060 INFO:teuthology.run_tasks:Running task rgw... 2020-04-28T12:54:38.080 DEBUG:tasks.rgw:config is {'client.0': None} 2020-04-28T12:54:38.080 DEBUG:tasks.rgw:client list is ['client.0'] 2020-04-28T12:54:38.080 INFO:tasks.rgw:Creating data pools 2020-04-28T12:54:38.081 DEBUG:tasks.rgw:Obtaining remote for client client.0 2020-04-28T12:54:38.081 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:38.095 INFO:teuthology.orchestra.run.smithi176:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2020-04-28T12:54:38.665 INFO:teuthology.orchestra.run.smithi176.stderr:pool 'default.rgw.buckets.data' created 2020-04-28T12:54:38.675 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:38.688 INFO:teuthology.orchestra.run.smithi176:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2020-04-28T12:54:39.690 INFO:teuthology.orchestra.run.smithi176.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-04-28T12:54:39.700 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi176:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2020-04-28T12:54:40.671 INFO:teuthology.orchestra.run.smithi176.stderr:pool 'default.rgw.buckets.index' created 2020-04-28T12:54:40.683 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:40.698 INFO:teuthology.orchestra.run.smithi176:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2020-04-28T12:54:41.680 INFO:teuthology.orchestra.run.smithi176.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-04-28T12:54:41.693 DEBUG:tasks.rgw:Pools created 2020-04-28T12:54:41.693 INFO:tasks.rgw:Configuring compression type = random 2020-04-28T12:54:41.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:54:41.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:54:41.693 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:41.708 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:54:41.789 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:41.785+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.681 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.677+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.681 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.677+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.682 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.678+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.683 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.678+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.683 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.679+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.683 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.679+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.684 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.680+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.721+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.726 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.726 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.727 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.727 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.727 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.722+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 10 Creating default zonegroup 2020-04-28T12:54:43.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 20 get_system_obj_state: rctx=0x7fff89ff29a0 obj=:.pools.avail state=0x5571e2418170 s->prefetch_data=0 2020-04-28T12:54:43.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.723+0000 7fd756adf180 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-04-28T12:54:43.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.726+0000 7fd744ac8700 0 -- 172.21.15.176:0/2225955449 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7fd72c0033b0 msgr2=0x7fd72c0037f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.732+0000 7fd7452c9700 0 -- 172.21.15.176:0/2225955449 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7fd72c002920 msgr2=0x7fd72c011150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.737+0000 7fd756adf180 10 WARNING: store->list_zones() returned r=-2 2020-04-28T12:54:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.737+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.737+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.740+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.740+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.740+0000 7fd756adf180 10 could not read realm id: (2) No such file or directory 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.740+0000 7fd756adf180 10 WARNING: failed to set zone as default, r=-22 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.740+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.741+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.743+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.744+0000 7fd756adf180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:54:43.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.744+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.744+0000 7fd756adf180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:54:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.744+0000 7fd756adf180 20 zonegroup default 2020-04-28T12:54:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.744+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 10 Cannot find current period zone using local zone 2020-04-28T12:54:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 10 Using default name default 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 zone default found 2020-04-28T12:54:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:43.745+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:45.693+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:45.693+0000 7fd756adf180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:45.694+0000 7fd756adf180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:45.694+0000 7fd756adf180 20 started sync module instance, tier type = 2020-04-28T12:54:45.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:45.694+0000 7fd756adf180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:54:47.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=0 2020-04-28T12:54:47.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=1 2020-04-28T12:54:47.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=2 2020-04-28T12:54:47.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=3 2020-04-28T12:54:47.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=4 2020-04-28T12:54:47.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=5 2020-04-28T12:54:47.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.724+0000 7fd756adf180 20 add_watcher() i=6 2020-04-28T12:54:47.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.725+0000 7fd756adf180 20 add_watcher() i=7 2020-04-28T12:54:47.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.725+0000 7fd756adf180 2 all 8 watchers are set, enabling cache 2020-04-28T12:54:47.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.725+0000 7fd756adf180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:47.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.725+0000 7fd756adf180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:47.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:47.725+0000 7fd7157e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:51.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.690+0000 7fd756adf180 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-04-28T12:54:51.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.755+0000 7fd67b7fe700 20 reqs_thread_entry: start 2020-04-28T12:54:51.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.755+0000 7fd679ffb700 20 reqs_thread_entry: start 2020-04-28T12:54:51.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.755+0000 7fd756adf180 20 init_complete bucket index max shards: 1999 2020-04-28T12:54:51.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.756+0000 7fd6737fe700 20 reqs_thread_entry: start 2020-04-28T12:54:51.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.770+0000 7fd7157e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:51.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.771+0000 7fd756adf180 20 remove_watcher() i=0 2020-04-28T12:54:51.777 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.771+0000 7fd756adf180 2 removed watcher, disabling cache 2020-04-28T12:54:51.777 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.772+0000 7fd756adf180 20 remove_watcher() i=1 2020-04-28T12:54:51.777 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.774+0000 7fd756adf180 20 remove_watcher() i=2 2020-04-28T12:54:51.783 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.775+0000 7fd756adf180 20 remove_watcher() i=3 2020-04-28T12:54:51.783 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.776+0000 7fd756adf180 20 remove_watcher() i=4 2020-04-28T12:54:51.783 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.777+0000 7fd756adf180 20 remove_watcher() i=5 2020-04-28T12:54:51.784 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.779+0000 7fd756adf180 20 remove_watcher() i=6 2020-04-28T12:54:51.784 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.780+0000 7fd756adf180 20 remove_watcher() i=7 2020-04-28T12:54:51.788 INFO:teuthology.orchestra.run.smithi176.stdout:[] 2020-04-28T12:54:51.788 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:54:51.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:54:51.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:54:51.789 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:51.842 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-04-28T12:54:51.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.924+0000 7efd7ce33180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:51.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.924+0000 7efd7ce33180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:51.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.927+0000 7efcb2ffd700 20 reqs_thread_entry: start 2020-04-28T12:54:51.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.927+0000 7efd7ce33180 20 rados->read ofs=0 len=0 2020-04-28T12:54:51.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.928+0000 7efd7ce33180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:51.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.928+0000 7efd7ce33180 20 rados->read ofs=0 len=0 2020-04-28T12:54:51.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.929+0000 7efd7ce33180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:54:51.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.929+0000 7efd7ce33180 20 rados->read ofs=0 len=0 2020-04-28T12:54:51.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.930+0000 7efd7ce33180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:51.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.930+0000 7efd7ce33180 20 rados->read ofs=0 len=0 2020-04-28T12:54:51.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.930+0000 7efd7ce33180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:51.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.930+0000 7efd7ce33180 20 rados->read ofs=0 len=0 2020-04-28T12:54:51.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:51.931+0000 7efd7ce33180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:54:51.944 INFO:teuthology.orchestra.run.smithi176.stdout:{"id":"5b3cbaf2-006a-4392-bd49-a3107d3aaf6a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:54:51.944 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5b3cbaf2-006a-4392-bd49-a3107d3aaf6a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:54:51.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:54:51.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:54:51.945 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:51.959 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:54:52.040 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.035+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.041 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.037+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.041 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.037+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.041 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.037+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.041 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.037+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.042 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.038+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.043 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.038+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.043 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.038+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.057 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.052+0000 7f0da2f70180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T12:54:52.057 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.052+0000 7f0da2f70180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T12:54:52.057 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.052+0000 7f0da2f70180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:54:52.057 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.052+0000 7f0da2f70180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:54:52.057 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.052+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.058 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.058 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.059 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.053+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.060 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.054+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0d90758700 0 -- 172.21.15.176:0/3345532992 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x55d1330df410 msgr2=0x55d1330e1860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.061 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:54:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0da2f70180 20 zonegroup default 2020-04-28T12:54:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.055+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 10 Cannot find current period zone using local zone 2020-04-28T12:54:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.064 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.064 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.056+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.064 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.057+0000 7f0da2f70180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:54:52.064 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.057+0000 7f0da2f70180 20 zone default found 2020-04-28T12:54:52.064 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.057+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.065 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.057+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.066 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.057+0000 7f0da2f70180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.066 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.058+0000 7f0da2f70180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.066 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.058+0000 7f0da2f70180 20 started sync module instance, tier type = 2020-04-28T12:54:52.066 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.058+0000 7f0da2f70180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:54:52.070 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.066+0000 7f0d90758700 0 -- 172.21.15.176:0/3345532992 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7f0d8803a940 msgr2=0x7f0d8803a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=0 2020-04-28T12:54:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=1 2020-04-28T12:54:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=2 2020-04-28T12:54:52.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=3 2020-04-28T12:54:52.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=4 2020-04-28T12:54:52.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=5 2020-04-28T12:54:52.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.069+0000 7f0da2f70180 20 add_watcher() i=6 2020-04-28T12:54:52.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.070+0000 7f0da2f70180 20 add_watcher() i=7 2020-04-28T12:54:52.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.070+0000 7f0da2f70180 2 all 8 watchers are set, enabling cache 2020-04-28T12:54:52.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.070+0000 7f0da2f70180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:52.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.070+0000 7f0da2f70180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:52.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.070+0000 7f0d617e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:52.120 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.116+0000 7f0cd37fe700 20 reqs_thread_entry: start 2020-04-28T12:54:52.120 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.116+0000 7f0cd17fa700 20 reqs_thread_entry: start 2020-04-28T12:54:52.120 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.116+0000 7f0da2f70180 20 init_complete bucket index max shards: 1999 2020-04-28T12:54:52.120 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.116+0000 7f0cbf7fe700 20 reqs_thread_entry: start 2020-04-28T12:54:52.133 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.128+0000 7f0d617e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:52.134 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.130+0000 7f0da2f70180 20 remove_watcher() i=0 2020-04-28T12:54:52.134 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.130+0000 7f0da2f70180 2 removed watcher, disabling cache 2020-04-28T12:54:52.134 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.131+0000 7f0da2f70180 20 remove_watcher() i=1 2020-04-28T12:54:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.132+0000 7f0da2f70180 20 remove_watcher() i=2 2020-04-28T12:54:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.133+0000 7f0da2f70180 20 remove_watcher() i=3 2020-04-28T12:54:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.134+0000 7f0da2f70180 20 remove_watcher() i=4 2020-04-28T12:54:52.139 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.135+0000 7f0da2f70180 20 remove_watcher() i=5 2020-04-28T12:54:52.140 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.137+0000 7f0da2f70180 20 remove_watcher() i=6 2020-04-28T12:54:52.141 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.138+0000 7f0da2f70180 20 remove_watcher() i=7 2020-04-28T12:54:52.145 INFO:teuthology.orchestra.run.smithi176.stdout:[] 2020-04-28T12:54:52.146 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:54:52.146 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2020-04-28T12:54:52.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:54:52.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:54:52.147 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.200 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2020-04-28T12:54:52.287 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.283+0000 7f9960423180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:52.287 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.283+0000 7f9960423180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:52.290 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.286+0000 7f98b67fc700 20 reqs_thread_entry: start 2020-04-28T12:54:52.290 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.286+0000 7f9960423180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.290 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.287+0000 7f9960423180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.291 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.287+0000 7f9960423180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.291 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.287+0000 7f9960423180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.292 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.287+0000 7f9960423180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.288+0000 7f9960423180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:54:52.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.288+0000 7f9960423180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.288+0000 7f9960423180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:54:52.297 INFO:teuthology.orchestra.run.smithi176.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2020-04-28T12:54:52.298 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:54:52.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:54:52.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:54:52.299 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.313 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2020-04-28T12:54:52.401 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.397+0000 7f05d6eec180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:52.401 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.397+0000 7f05d6eec180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:52.404 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.400+0000 7f0514ff9700 20 reqs_thread_entry: start 2020-04-28T12:54:52.404 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.400+0000 7f05d6eec180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.405 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.401+0000 7f05d6eec180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.405 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.401+0000 7f05d6eec180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.406 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.402+0000 7f05d6eec180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:54:52.406 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.402+0000 7f05d6eec180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.407 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.403+0000 7f05d6eec180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.407 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.403+0000 7f05d6eec180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.408 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.403+0000 7f05d6eec180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.408 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.403+0000 7f05d6eec180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.408 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.404+0000 7f05d6eec180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:54:52.412 INFO:teuthology.orchestra.run.smithi176.stdout:{"id":"5b3cbaf2-006a-4392-bd49-a3107d3aaf6a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:54:52.413 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5b3cbaf2-006a-4392-bd49-a3107d3aaf6a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:54:52.413 INFO:tasks.rgw:Configuring storage class type = FROZEN 2020-04-28T12:54:52.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:54:52.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:54:52.414 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.427 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2020-04-28T12:54:52.512 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.508+0000 7f587dcc1180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:52.512 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.508+0000 7f587dcc1180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:52.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.511+0000 7f57af7fe700 20 reqs_thread_entry: start 2020-04-28T12:54:52.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.511+0000 7f587dcc1180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.512+0000 7f587dcc1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.516 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.512+0000 7f587dcc1180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.516 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.512+0000 7f587dcc1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.516 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.512+0000 7f587dcc1180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.513+0000 7f587dcc1180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:54:52.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.513+0000 7f587dcc1180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.513+0000 7f587dcc1180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:54:52.522 INFO:teuthology.orchestra.run.smithi176.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2020-04-28T12:54:52.523 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:54:52.523 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:54:52.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:54:52.523 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.537 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2020-04-28T12:54:52.624 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.621+0000 7f22c6341180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:52.625 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.621+0000 7f22c6341180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:52.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.624+0000 7f21fbfff700 20 reqs_thread_entry: start 2020-04-28T12:54:52.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.624+0000 7f22c6341180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.625+0000 7f22c6341180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.625+0000 7f22c6341180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.626+0000 7f22c6341180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:54:52.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.626+0000 7f22c6341180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.627+0000 7f22c6341180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:52.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.627+0000 7f22c6341180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.627+0000 7f22c6341180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:52.632 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.627+0000 7f22c6341180 20 rados->read ofs=0 len=0 2020-04-28T12:54:52.632 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:54:52.627+0000 7f22c6341180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:54:52.636 INFO:teuthology.orchestra.run.smithi176.stdout:{"id":"5b3cbaf2-006a-4392-bd49-a3107d3aaf6a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:54:52.637 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5b3cbaf2-006a-4392-bd49-a3107d3aaf6a', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:54:52.637 INFO:tasks.rgw:Starting rgw... 2020-04-28T12:54:52.637 INFO:tasks.rgw:rgw client.0 config is {} 2020-04-28T12:54:52.637 INFO:tasks.rgw:Using beast as radosgw frontend 2020-04-28T12:54:52.637 INFO:tasks.rgw.client.0:Restarting daemon 2020-04-28T12:54:52.638 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.651 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2020-04-28T12:54:52.693 INFO:tasks.rgw.client.0:Started 2020-04-28T12:54:52.693 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi176.front.sepia.ceph.com:80/ 2020-04-28T12:54:52.693 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:52.707 INFO:teuthology.orchestra.run.smithi176:> curl http://smithi176.front.sepia.ceph.com:80/ 2020-04-28T12:54:52.776 INFO:teuthology.orchestra.run.smithi176.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:54:52.776 INFO:teuthology.orchestra.run.smithi176.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:54:52.777 INFO:teuthology.orchestra.run.smithi176.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi176.front.sepia.ceph.com port 80: Connection refused 2020-04-28T12:54:52.777 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-04-28T12:54:53.777 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:53.791 INFO:teuthology.orchestra.run.smithi176:> curl http://smithi176.front.sepia.ceph.com:80/ 2020-04-28T12:54:53.847 INFO:teuthology.orchestra.run.smithi176.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:54:53.847 INFO:teuthology.orchestra.run.smithi176.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:54:53.849 INFO:teuthology.orchestra.run.smithi176.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2020-04-28T12:54:53.849 INFO:teuthology.orchestra.run.smithi176.stdout:anonymous 2020-04-28T12:54:53.850 INFO:teuthology.run_tasks:Running task workunit... 2020-04-28T12:54:53.865 INFO:tasks.workunit:Pulling workunits from ref a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:54:53.865 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-28T12:54:53.867 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:53.906 INFO:teuthology.orchestra.run.smithi176:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:54:53.960 INFO:teuthology.orchestra.run.smithi176.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-28T12:54:53.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:54:53.960 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:54.013 INFO:teuthology.orchestra.run.smithi176:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:54:54.067 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-04-28T12:54:54.067 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:54.120 INFO:teuthology.orchestra.run.smithi176:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-04-28T12:54:54.173 INFO:tasks.workunit:timeout=3h 2020-04-28T12:54:54.173 INFO:tasks.workunit:cleanup=True 2020-04-28T12:54:54.174 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:54:54.226 INFO:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:54:54.337 INFO:tasks.workunit.client.0.smithi176.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-28T12:56:17.266 INFO:tasks.workunit.client.0.smithi176.stderr:Note: checking out 'a8c125c7d78f5cd973863993d258cd717ade4c99'. 2020-04-28T12:56:17.266 INFO:tasks.workunit.client.0.smithi176.stderr: 2020-04-28T12:56:17.266 INFO:tasks.workunit.client.0.smithi176.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr:state without impacting any branches by performing another checkout. 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr: 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr: 2020-04-28T12:56:17.267 INFO:tasks.workunit.client.0.smithi176.stderr: git checkout -b 2020-04-28T12:56:17.268 INFO:tasks.workunit.client.0.smithi176.stderr: 2020-04-28T12:56:17.268 INFO:tasks.workunit.client.0.smithi176.stderr:HEAD is now at a8c125c7d7 Merge pull request #34750 from yuriw/wip-yuriw-distro-octupus 2020-04-28T12:56:17.269 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:56:17.283 INFO:teuthology.orchestra.run.smithi176:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-28T12:56:17.343 INFO:tasks.workunit.client.0.smithi176.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-28T12:56:17.344 INFO:tasks.workunit.client.0.smithi176.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:56:17.345 INFO:tasks.workunit.client.0.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-28T12:56:18.096 INFO:tasks.workunit.client.0.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-28T12:56:18.148 INFO:tasks.workunit.client.0.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-28T12:56:18.186 INFO:tasks.workunit.client.0.smithi176.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:56:18.187 INFO:tasks.workunit.client.0.smithi176.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:56:18.187 INFO:tasks.workunit.client.0.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-28T12:56:18.223 INFO:tasks.workunit.client.0.smithi176.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:56:18.285 DEBUG:teuthology.orchestra.remote:smithi176:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-28T12:56:18.357 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2020-04-28T12:56:18.358 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2020-04-28T12:56:18.359 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:56:18.373 INFO:teuthology.orchestra.run.smithi176:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2020-04-28T12:56:18.439 INFO:tasks.workunit.client.0.smithi176.stdout:Running main() from gmock_main.cc 2020-04-28T12:56:18.440 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 11 tests from 1 test suite. 2020-04-28T12:56:18.440 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:56:18.440 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 11 tests from ClsLock 2020-04-28T12:56:18.440 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestMultiLocking 2020-04-28T12:56:19.703 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:19.703 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: exclusive 2020-04-28T12:56:19.703 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:19.704 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:19.704 INFO:tasks.workunit.client.0.smithi176.stdout: client.4370 expiration=2020-04-28T12:58:19.695508+0000 addr=v1:172.21.15.176:0/2068349182 cookie= 2020-04-28T12:56:19.710 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: shared 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: client.4370 expiration=2020-04-28T12:58:19.703275+0000 addr=v1:172.21.15.176:0/2068349182 cookie= 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: client.4569 expiration=0.000000 addr=v1:172.21.15.176:0/1863291348 cookie= 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:19.711 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: shared 2020-04-28T12:56:19.712 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:19.712 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:19.712 INFO:tasks.workunit.client.0.smithi176.stdout: client.4569 expiration=0.000000 addr=v1:172.21.15.176:0/1863291348 cookie= 2020-04-28T12:56:20.659 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestMultiLocking (2219 ms) 2020-04-28T12:56:20.659 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestMeta 2020-04-28T12:56:22.715 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:22.715 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: shared 2020-04-28T12:56:22.715 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:22.715 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:22.715 INFO:tasks.workunit.client.0.smithi176.stdout: client.4382 expiration=0.000000 addr=v1:172.21.15.176:0/463717506 cookie= 2020-04-28T12:56:22.719 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:22.719 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: exclusive 2020-04-28T12:56:22.719 INFO:tasks.workunit.client.0.smithi176.stdout: tag: new_tag 2020-04-28T12:56:22.720 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:22.720 INFO:tasks.workunit.client.0.smithi176.stdout: client.4376 expiration=0.000000 addr=v1:172.21.15.176:0/2173966994 cookie= 2020-04-28T12:56:23.681 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestMeta (3023 ms) 2020-04-28T12:56:23.682 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestCookie 2020-04-28T12:56:25.724 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:25.724 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: exclusive 2020-04-28T12:56:25.724 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:25.724 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:25.726 INFO:tasks.workunit.client.0.smithi176.stdout:lock: mylock 2020-04-28T12:56:25.726 INFO:tasks.workunit.client.0.smithi176.stdout: lock_type: shared 2020-04-28T12:56:25.727 INFO:tasks.workunit.client.0.smithi176.stdout: tag: 2020-04-28T12:56:25.727 INFO:tasks.workunit.client.0.smithi176.stdout: lockers: 2020-04-28T12:56:25.727 INFO:tasks.workunit.client.0.smithi176.stdout: client.4388 expiration=0.000000 addr=v1:172.21.15.176:0/3498091589 cookie= 2020-04-28T12:56:25.727 INFO:tasks.workunit.client.0.smithi176.stdout: client.4388 expiration=0.000000 addr=v1:172.21.15.176:0/3498091589 cookie=new cookie 2020-04-28T12:56:26.697 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestCookie (3015 ms) 2020-04-28T12:56:26.697 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestMultipleLocks 2020-04-28T12:56:29.708 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestMultipleLocks (3012 ms) 2020-04-28T12:56:29.709 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestLockDuration 2020-04-28T12:56:37.638 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestLockDuration (7929 ms) 2020-04-28T12:56:37.638 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestAssertLocked 2020-04-28T12:56:40.656 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestAssertLocked (3018 ms) 2020-04-28T12:56:40.656 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestSetCookie 2020-04-28T12:56:43.687 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestSetCookie (3028 ms) 2020-04-28T12:56:43.687 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestRenew 2020-04-28T12:57:04.650 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestRenew (20966 ms) 2020-04-28T12:57:04.650 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2020-04-28T12:57:11.684 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7033 ms) 2020-04-28T12:57:11.684 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2020-04-28T12:57:19.635 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7951 ms) 2020-04-28T12:57:19.635 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2020-04-28T12:57:27.637 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8002 ms) 2020-04-28T12:57:27.637 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 11 tests from ClsLock (69197 ms total) 2020-04-28T12:57:27.637 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:57:27.637 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:57:27.637 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 11 tests from 1 test suite ran. (69197 ms total) 2020-04-28T12:57:27.638 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 11 tests. 2020-04-28T12:57:27.638 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:57:27.693 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:57:27.694 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:57:27.769 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2020-04-28T12:57:27.769 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2020-04-28T12:57:27.769 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:57:27.817 INFO:teuthology.orchestra.run.smithi176:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2020-04-28T12:57:27.885 INFO:tasks.workunit.client.0.smithi176.stdout:Running main() from gmock_main.cc 2020-04-28T12:57:27.886 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:57:27.886 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:57:27.886 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 4 tests from cls_log 2020-04-28T12:57:27.886 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_log.test_log_add_same_time 2020-04-28T12:57:30.692 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_log.test_log_add_same_time (2806 ms) 2020-04-28T12:57:30.692 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_log.test_log_add_different_time 2020-04-28T12:57:33.709 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_log.test_log_add_different_time (3018 ms) 2020-04-28T12:57:33.710 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_log.trim_by_time 2020-04-28T12:57:36.739 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_log.trim_by_time (3029 ms) 2020-04-28T12:57:36.739 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_log.trim_by_marker 2020-04-28T12:57:39.756 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_log.trim_by_marker (3018 ms) 2020-04-28T12:57:39.757 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 4 tests from cls_log (11871 ms total) 2020-04-28T12:57:39.757 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:57:39.757 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:57:39.757 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 4 tests from 1 test suite ran. (11871 ms total) 2020-04-28T12:57:39.757 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 4 tests. 2020-04-28T12:57:39.759 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:57:39.814 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:57:39.814 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:57:39.889 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2020-04-28T12:57:39.890 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2020-04-28T12:57:39.890 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:57:39.937 INFO:teuthology.orchestra.run.smithi176:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2020-04-28T12:57:40.007 INFO:tasks.workunit.client.0.smithi176.stdout:Running main() from gmock_main.cc 2020-04-28T12:57:40.008 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:57:40.008 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:57:40.008 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 5 tests from cls_rgw 2020-04-28T12:57:40.008 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.test_implicit 2020-04-28T12:57:42.783 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.test_implicit (2778 ms) 2020-04-28T12:57:42.784 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2020-04-28T12:57:45.808 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3024 ms) 2020-04-28T12:57:45.808 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.test_put_snap 2020-04-28T12:57:53.655 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T12:57:53.649+0000 7f13ad887700 -1 osd.3 pg_epoch: 95 pg[26.6( v 94'4 (0'0,94'4] local-lis/les=90/91 n=2 ec=90/90 lis/c=90/90 les/c/f=91/91/0 sis=90) [3,2] r=0 lpr=90 crt=93'3 lcod 93'3 mlcod 93'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2020-04-28T12:57:55.670 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.test_put_snap (9862 ms) 2020-04-28T12:57:55.671 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.test_explicit 2020-04-28T12:57:58.688 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.test_explicit (3018 ms) 2020-04-28T12:57:58.688 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.set 2020-04-28T12:58:01.704 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.set (3016 ms) 2020-04-28T12:58:01.704 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 5 tests from cls_rgw (21699 ms total) 2020-04-28T12:58:01.705 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:58:01.705 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:58:01.705 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 5 tests from 1 test suite ran. (21699 ms total) 2020-04-28T12:58:01.705 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 5 tests. 2020-04-28T12:58:01.706 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:01.762 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:58:01.762 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:58:01.838 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2020-04-28T12:58:01.839 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2020-04-28T12:58:01.839 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:01.893 INFO:teuthology.orchestra.run.smithi176:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2020-04-28T12:58:01.960 INFO:tasks.workunit.client.0.smithi176.stdout:Running main() from gmock_main.cc 2020-04-28T12:58:01.960 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 14 tests from 1 test suite. 2020-04-28T12:58:01.960 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:58:01.960 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 14 tests from cls_rgw 2020-04-28T12:58:03.732 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_basic 2020-04-28T12:58:03.790 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_basic (57 ms) 2020-04-28T12:58:03.790 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2020-04-28T12:58:03.833 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (44 ms) 2020-04-28T12:58:03.834 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_remove_object 2020-04-28T12:58:03.880 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_remove_object (46 ms) 2020-04-28T12:58:03.880 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_suggest 2020-04-28T12:58:05.450 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_suggest (1570 ms) 2020-04-28T12:58:05.450 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_list 2020-04-28T12:58:05.480 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_list (30 ms) 2020-04-28T12:58:05.480 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.index_list_delimited 2020-04-28T12:58:31.534 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.index_list_delimited (26055 ms) 2020-04-28T12:58:31.535 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.bi_list 2020-04-28T12:58:31.627 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.bi_list (93 ms) 2020-04-28T12:58:31.628 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.gc_set 2020-04-28T12:58:31.641 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.gc_set (14 ms) 2020-04-28T12:58:31.641 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.gc_list 2020-04-28T12:58:31.857 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.gc_list (215 ms) 2020-04-28T12:58:31.857 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.gc_defer 2020-04-28T12:58:38.776 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.gc_defer (6919 ms) 2020-04-28T12:58:38.776 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.usage_basic 2020-04-28T12:58:38.935 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.usage_basic (160 ms) 2020-04-28T12:58:38.936 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2020-04-28T12:58:38.937 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2020-04-28T12:58:38.937 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.usage_clear 2020-04-28T12:58:39.042 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.usage_clear (104 ms) 2020-04-28T12:58:39.042 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] cls_rgw.bi_log_trim 2020-04-28T12:58:39.162 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] cls_rgw.bi_log_trim (121 ms) 2020-04-28T12:58:39.783 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 14 tests from cls_rgw (35431 ms total) 2020-04-28T12:58:39.783 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:58:39.783 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:58:39.783 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 14 tests from 1 test suite ran. (37823 ms total) 2020-04-28T12:58:39.784 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 14 tests. 2020-04-28T12:58:39.785 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:39.839 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:58:39.839 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:58:39.914 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2020-04-28T12:58:39.914 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2020-04-28T12:58:39.915 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:39.960 INFO:teuthology.orchestra.run.smithi176:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2020-04-28T12:58:40.042 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 6 tests from 1 test suite. 2020-04-28T12:58:40.042 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:58:41.795 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 6 tests from rgw_gc_log 2020-04-28T12:58:41.795 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2020-04-28T12:58:41.836 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.init_existing_queue (41 ms) 2020-04-28T12:58:41.836 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2020-04-28T12:58:41.842 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2020-04-28T12:58:41.842 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2020-04-28T12:58:41.843 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2020-04-28T12:58:41.843 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2020-04-28T12:58:41.845 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2020-04-28T12:58:41.845 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2020-04-28T12:58:41.848 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2020-04-28T12:58:41.848 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2020-04-28T12:58:41.852 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2020-04-28T12:58:41.852 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 6 tests from rgw_gc_log (55 ms total) 2020-04-28T12:58:41.852 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:58:41.852 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:58:42.797 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 6 tests from 1 test suite ran. (2757 ms total) 2020-04-28T12:58:42.797 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 6 tests. 2020-04-28T12:58:42.800 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:42.855 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:58:42.855 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:58:42.931 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2020-04-28T12:58:42.931 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2020-04-28T12:58:42.932 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:42.981 INFO:teuthology.orchestra.run.smithi176:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:Running main() from gmock_main.cc 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 4 tests from TestRGWObj 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] TestRGWObj.underscore 2020-04-28T12:58:43.056 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i= 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i= 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.057 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i= 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.058 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.059 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.059 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.059 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.061 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.062 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.062 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.063 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.063 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.063 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.063 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.063 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.064 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.065 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.066 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.066 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.067 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.068 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.069 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.069 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.069 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.069 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.069 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.070 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.071 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.072 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.073 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i= 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i= 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.074 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj 2020-04-28T12:58:43.075 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i= 2020-04-28T12:58:43.075 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.075 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.075 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.075 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.076 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.077 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.078 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.079 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.080 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.081 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.082 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.083 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.084 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.085 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.085 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.085 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.085 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.085 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i=v1 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.086 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i=v1 2020-04-28T12:58:43.087 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.087 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns= i=v1 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.088 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.089 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.089 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.091 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.091 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.091 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.091 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.091 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.092 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.093 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.094 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.095 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.096 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.096 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.096 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.096 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.096 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.097 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.098 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.098 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.098 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.098 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.098 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.099 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.099 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.099 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.099 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.100 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.101 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:58:43.102 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: _obj[v1] 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.103 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.104 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.105 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.106 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.106 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.106 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.106 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.107 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.107 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.107 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.107 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.108 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.108 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.108 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.108 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.109 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.109 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.109 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.110 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.111 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.112 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.113 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.113 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.113 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.113 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.113 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.114 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_obj", 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.115 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.116 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2020-04-28T12:58:43.116 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] TestRGWObj.no_underscore 2020-04-28T12:58:43.116 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.116 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i= 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i= 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.117 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i= 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.118 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.119 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.120 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.121 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.122 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.123 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.124 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.125 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.126 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.127 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.128 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i= 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i= 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.129 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i= 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.130 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.131 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.132 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.133 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.133 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.133 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.134 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.134 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.134 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.135 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.135 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.135 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.135 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.135 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.136 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.137 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.138 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.139 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.140 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.141 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.142 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i=v1 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i=v1 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns= i=v1 2020-04-28T12:58:43.143 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.144 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.145 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.146 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.147 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.148 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.149 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.150 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.151 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.152 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.153 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:58:43.154 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:parsed: obj[v1] 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.155 INFO:tasks.workunit.client.0.smithi176.stdout: "obj1": { 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.156 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.157 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: "obj2": { 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.158 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.159 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.160 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3": { 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.161 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.162 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: "obj3-2": { 2020-04-28T12:58:43.163 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.164 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "obj", 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "v1", 2020-04-28T12:58:43.165 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] TestRGWObj.obj_to_raw 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.166 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.167 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.168 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.169 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.170 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.171 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.171 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.171 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.171 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.171 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker_myobj", 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.172 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.173 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.174 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.175 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.176 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.177 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.177 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.177 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.177 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.177 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.178 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.179 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.180 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.180 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.180 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.180 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.180 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.181 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.182 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker_myobj", 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.183 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.184 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.185 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.186 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.187 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.188 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.189 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.190 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.191 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.192 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.193 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.194 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.195 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.196 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.197 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.198 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.198 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.198 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.198 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.199 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.200 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.201 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.202 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.202 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.202 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.202 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.202 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.203 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.204 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.205 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.206 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.207 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.208 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.209 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.210 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.211 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.212 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.213 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.214 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.215 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.216 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.217 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.218 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.218 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.218 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.218 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.218 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.219 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.220 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.221 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.222 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.223 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.224 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.225 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.225 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.225 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.225 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.225 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.226 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.227 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.228 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.229 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.230 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.230 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.230 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.230 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.230 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.231 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.232 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.233 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.233 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.233 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.233 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.234 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.234 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.234 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.235 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.236 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.236 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.236 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.237 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.237 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.238 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:58:43.239 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.240 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.240 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.240 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.240 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.240 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.241 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.242 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.243 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.244 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.245 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.246 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.247 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.248 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.249 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.249 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.249 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.249 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.250 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj", 2020-04-28T12:58:43.250 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.250 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.250 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.250 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.251 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.252 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.252 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.252 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.252 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.252 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.253 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.254 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.255 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.256 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.257 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.258 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj", 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.259 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.260 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.261 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.261 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.261 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.261 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.261 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.262 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.263 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.264 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.264 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.264 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.264 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.264 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.265 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.266 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.267 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:58:43.268 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.269 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.270 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.271 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.272 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.273 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.274 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.275 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.276 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.277 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.278 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.279 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.280 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.281 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.281 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.281 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.282 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.282 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.282 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.283 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.283 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.283 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.283 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.283 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.284 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.285 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.286 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.287 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.288 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.289 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.290 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.291 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.292 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.292 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.292 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.292 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.292 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.293 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.294 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.295 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.295 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.296 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.297 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.298 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.299 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.300 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.301 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.302 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.303 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.304 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.305 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.306 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.307 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.307 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.307 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.307 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.307 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.308 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.309 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.310 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.311 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.312 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.313 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.314 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.315 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.316 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.317 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.318 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.319 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.320 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.321 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.322 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.323 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj_", 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.324 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.325 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.325 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.325 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.325 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.325 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.326 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.327 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.328 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.329 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.330 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.331 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.332 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.332 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.332 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.332 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.332 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.333 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj_", 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.334 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.335 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.336 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.337 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.337 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.338 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.338 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.338 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.338 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.339 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.339 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.339 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.339 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.340 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.341 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.341 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.341 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.341 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.342 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.342 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.342 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.342 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.342 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.343 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.344 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.345 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.346 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.347 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.348 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.349 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.350 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.351 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.352 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.353 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.354 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.355 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.356 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.357 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.358 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.359 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.360 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.361 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.361 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.361 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.361 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.361 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.362 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.363 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.364 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.365 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.366 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.367 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.368 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.369 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.370 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.371 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.371 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.372 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.373 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.374 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.375 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.376 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.377 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.378 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.379 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.380 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": "default-placement.data", 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.381 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "test", 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.382 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": "", 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": "" 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.383 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.384 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.385 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout: "obj": { 2020-04-28T12:58:43.386 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.387 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.388 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.389 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.390 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.391 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.392 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] TestRGWObj.old_to_raw 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.393 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker_myobj", 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.394 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.395 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.396 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.397 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.397 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.397 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.397 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.397 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.398 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker_myobj 2020-04-28T12:58:43.399 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.399 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker_myobj", 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.400 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.401 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.402 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker_myobj 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.403 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.404 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.405 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.406 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.407 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns_myobj 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.408 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.409 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.410 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.411 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns_myobj 2020-04-28T12:58:43.412 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.413 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.414 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.414 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.415 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.416 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__:inst_myobj 2020-04-28T12:58:43.417 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.418 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.418 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.418 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:58:43.418 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.419 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.419 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.419 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.419 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.419 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.420 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.420 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.420 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.421 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.422 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.423 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.424 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__:inst_myobj 2020-04-28T12:58:43.424 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.424 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.424 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.425 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.426 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.427 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.428 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.428 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.428 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns:inst_myobj 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:58:43.429 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.430 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.431 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "myobj", 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.432 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns:inst_myobj 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj", 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.433 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.434 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.435 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.436 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker___myobj 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj", 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.437 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.438 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.439 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.440 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.440 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.441 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.441 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker___myobj 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.442 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.443 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.444 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.445 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns__myobj 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.446 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.447 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.448 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.448 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.448 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.448 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.449 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.449 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.449 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.449 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.449 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.450 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns__myobj 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:58:43.451 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.452 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.453 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.454 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__:inst__myobj 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.455 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj" 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.456 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.457 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.458 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__:inst__myobj 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.459 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.460 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.461 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.462 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.462 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.462 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.462 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.462 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.463 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns:inst__myobj 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.464 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.465 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.466 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj", 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.467 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns:inst__myobj 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj_", 2020-04-28T12:58:43.468 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.469 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.470 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.471 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker___myobj_ 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.472 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker___myobj_", 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.473 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.474 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.475 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker___myobj_ 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.476 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.477 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.478 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.479 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns__myobj_ 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.480 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.481 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.482 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.483 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.483 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.483 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.483 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.484 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.484 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.484 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.484 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "", 2020-04-28T12:58:43.485 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.485 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.485 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.485 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.485 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns__myobj_ 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.486 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.487 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.488 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.489 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__:inst__myobj_ 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "marker__myobj_" 2020-04-28T12:58:43.490 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.491 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.492 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.493 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.493 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.493 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "" 2020-04-28T12:58:43.493 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.493 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__:inst__myobj_ 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj": { 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:58:43.494 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj": { 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.495 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.496 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.497 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout: "raw_obj2": { 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout: "pool": ".data-pool", 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout: "loc": "" 2020-04-28T12:58:43.498 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout:{ 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout: "new_obj2": { 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket": { 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "ebtest", 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout: "marker": "marker", 2020-04-28T12:58:43.499 INFO:tasks.workunit.client.0.smithi176.stdout: "bucket_id": "bucket-id", 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: "tenant": "", 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: "explicit_placement": { 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: "data_pool": ".data-pool", 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: "data_extra_pool": "", 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: "index_pool": ".index-pool" 2020-04-28T12:58:43.500 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: }, 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: "key": { 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: "name": "_myobj_", 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: "instance": "inst", 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: "ns": "ns" 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout: } 2020-04-28T12:58:43.501 INFO:tasks.workunit.client.0.smithi176.stdout:} 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2020-04-28T12:58:43.502 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 4 tests. 2020-04-28T12:58:43.503 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:43.519 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:58:43.520 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:58:43.595 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_throttle.sh on client.0... 2020-04-28T12:58:43.595 INFO:tasks.workunit:Running workunit rgw/test_rgw_throttle.sh... 2020-04-28T12:58:43.596 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:43.647 INFO:teuthology.orchestra.run.smithi176:workunit test rgw/test_rgw_throttle.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh 2020-04-28T12:58:43.727 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:58:43.727 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment set-up. 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 5 tests from Aio_Throttle 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] Aio_Throttle.NoThrottleUpToMax 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] Aio_Throttle.NoThrottleUpToMax (0 ms) 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] Aio_Throttle.CostOverWindow 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] Aio_Throttle.CostOverWindow (0 ms) 2020-04-28T12:58:44.815 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] Aio_Throttle.ThrottleOverMax 2020-04-28T12:58:44.903 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] Aio_Throttle.ThrottleOverMax (88 ms) 2020-04-28T12:58:44.903 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] Aio_Throttle.YieldCostOverWindow 2020-04-28T12:58:44.903 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] Aio_Throttle.YieldCostOverWindow (0 ms) 2020-04-28T12:58:44.903 INFO:tasks.workunit.client.0.smithi176.stdout:[ RUN ] Aio_Throttle.YieldingThrottleOverMax 2020-04-28T12:58:44.991 INFO:tasks.workunit.client.0.smithi176.stdout:[ OK ] Aio_Throttle.YieldingThrottleOverMax (88 ms) 2020-04-28T12:58:44.991 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] 5 tests from Aio_Throttle (177 ms total) 2020-04-28T12:58:44.991 INFO:tasks.workunit.client.0.smithi176.stdout: 2020-04-28T12:58:44.991 INFO:tasks.workunit.client.0.smithi176.stdout:[----------] Global test environment tear-down 2020-04-28T12:58:44.992 INFO:tasks.workunit.client.0.smithi176.stdout:[==========] 5 tests from 1 test suite ran. (1265 ms total) 2020-04-28T12:58:44.992 INFO:tasks.workunit.client.0.smithi176.stdout:[ PASSED ] 5 tests. 2020-04-28T12:58:44.994 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.048 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:58:45.048 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:58:45.124 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh'] on client.0... 2020-04-28T12:58:45.125 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.173 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-28T12:58:45.390 DEBUG:teuthology.parallel:result is None 2020-04-28T12:58:45.390 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.404 INFO:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:58:45.471 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:58:45.471 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.524 INFO:teuthology.orchestra.run.smithi176:> rmdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:58:45.577 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:58:45.577 INFO:teuthology.run_tasks:Running task ragweed... 2020-04-28T12:58:45.591 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2020-04-28T12:58:45.592 INFO:tasks.ragweed:Downloading ragweed... 2020-04-28T12:58:45.592 INFO:tasks.ragweed:Using branch 'octopus' for ragweed 2020-04-28T12:58:45.592 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.631 INFO:teuthology.orchestra.run.smithi176:> git clone -b octopus git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:58:45.684 INFO:teuthology.orchestra.run.smithi176.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:58:45.791 INFO:teuthology.orchestra.run.smithi176.stderr:fatal: Remote branch octopus not found in upstream origin 2020-04-28T12:58:45.792 DEBUG:teuthology.orchestra.run:got remote process result: 128 2020-04-28T12:58:45.792 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:45.845 INFO:teuthology.orchestra.run.smithi176:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:58:45.899 INFO:teuthology.orchestra.run.smithi176.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:58:47.071 INFO:tasks.ragweed:Creating rgw users... 2020-04-28T12:58:47.071 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2020-04-28T12:58:47.072 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:47.127 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key LTVBYMUYCEPDMXKERCPC --secret Set+TuBoob8eLh4ovch2jFYZm1FGlmSxru2f9lMT+fQOwsmuefDbcg== --email sysuser.client.0+test@test.test --system true 2020-04-28T12:58:47.221 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.217+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.223 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.219+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.223 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.219+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.223 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.220+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.224 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.220+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.224 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.220+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.224 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.220+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.225 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.221+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.241 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T12:58:47.241 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T12:58:47.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:58:47.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:58:47.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.237+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.238+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:58:47.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.238+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.238+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.238+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:58:47.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.239+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.246 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.240+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.246 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.240+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.246 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.240+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.240+0000 7f023ed6e180 20 zonegroup default 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.240+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 10 Cannot find current period zone using local zone 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.241+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.242+0000 7f023ed6e180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.242+0000 7f023ed6e180 20 zone default found 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.242+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.242+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.242+0000 7f023ed6e180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.243+0000 7f023ed6e180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.243+0000 7f023ed6e180 20 started sync module instance, tier type = 2020-04-28T12:58:47.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.243+0000 7f023ed6e180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:58:47.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.246+0000 7f022cd57700 0 -- 172.21.15.176:0/2979456795 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7f022003e260 msgr2=0x7f022003dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:58:47.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=0 2020-04-28T12:58:47.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=1 2020-04-28T12:58:47.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=2 2020-04-28T12:58:47.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=3 2020-04-28T12:58:47.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=4 2020-04-28T12:58:47.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=5 2020-04-28T12:58:47.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.254+0000 7f023ed6e180 20 add_watcher() i=6 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.255+0000 7f023ed6e180 20 add_watcher() i=7 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.255+0000 7f023ed6e180 2 all 8 watchers are set, enabling cache 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.255+0000 7f023ed6e180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.255+0000 7f023ed6e180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.256+0000 7f01fd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:58:47.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.256+0000 7f022cd57700 0 -- 172.21.15.176:0/4238448875 >> v1:172.21.15.84:6789/0 conn(0x5583525ee530 legacy=0x5583525ef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f016f7fe700 20 reqs_thread_entry: start 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f016d7fa700 20 reqs_thread_entry: start 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f023ed6e180 20 init_complete bucket index max shards: 1999 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f015b7fe700 20 reqs_thread_entry: start 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f023ed6e180 20 get_system_obj_state: rctx=0x7ffc59f0fe48 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x558352497170 s->prefetch_data=0 2020-04-28T12:58:47.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.307+0000 7f023ed6e180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:58:47.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2020-04-28T12:58:47.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:58:47.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 20 get_system_obj_state: rctx=0x7ffc59f0fe58 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x558352497170 s->prefetch_data=0 2020-04-28T12:58:47.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 20 get_system_obj_state: rctx=0x7ffc59f0fe58 obj=default.rgw.meta:users.keys:LTVBYMUYCEPDMXKERCPC state=0x558352497170 s->prefetch_data=0 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache get: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC : miss 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC info.flags=0x0 2020-04-28T12:58:47.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 adding default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC to cache LRU end 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 20 get_system_obj_state: rctx=0x7ffc59f0f868 obj=default.rgw.meta:users.keys:LTVBYMUYCEPDMXKERCPC state=0x558352497170 s->prefetch_data=0 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.308+0000 7f023ed6e180 10 cache get: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC : type miss (requested=0x6, cached=0x0) 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC info.flags=0x0 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 10 moving default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC to cache LRU end 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 20 get_system_obj_state: rctx=0x7ffc59f0fb58 obj=default.rgw.meta:users.keys:LTVBYMUYCEPDMXKERCPC state=0x558352497170 s->prefetch_data=0 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 10 cache get: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC : type miss (requested=0x6, cached=0x0) 2020-04-28T12:58:47.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC info.flags=0x0 2020-04-28T12:58:47.317 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.309+0000 7f023ed6e180 10 moving default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC to cache LRU end 2020-04-28T12:58:47.317 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.310+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:58:47.318 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.310+0000 7f023ed6e180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:58:47.318 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.310+0000 7f023ed6e180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2020-04-28T12:58:47.318 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.311+0000 7f02127fc700 10 RGWWatcher::handle_notify() notify_id 502511173632 cookie 94022510955536 notifier 4475 bl.length()=637 2020-04-28T12:58:47.318 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.311+0000 7f02127fc700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:58:47.318 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.311+0000 7f02127fc700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:58:47.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.312+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:58:47.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.312+0000 7f023ed6e180 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.312+0000 7f023ed6e180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2020-04-28T12:58:47.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.313+0000 7f02127fc700 10 RGWWatcher::handle_notify() notify_id 502511173632 cookie 94022510960336 notifier 4475 bl.length()=202 2020-04-28T12:58:47.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.313+0000 7f02127fc700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.313+0000 7f02127fc700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f023ed6e180 10 cache put: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC info.flags=0x7 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f023ed6e180 10 moving default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC to cache LRU end 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f023ed6e180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f02127fc700 10 RGWWatcher::handle_notify() notify_id 502511173633 cookie 94022510960336 notifier 4475 bl.length()=190 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f02127fc700 10 cache put: name=default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC info.flags=0x7 2020-04-28T12:58:47.323 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.315+0000 7f02127fc700 10 moving default.rgw.meta+users.keys+LTVBYMUYCEPDMXKERCPC to cache LRU end 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.316+0000 7f01fd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.317+0000 7f023ed6e180 20 remove_watcher() i=0 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.317+0000 7f023ed6e180 2 removed watcher, disabling cache 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stdout: "user_id": "sysuser.client.0", 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stdout: "display_name": "Mr. sysuser.client.0", 2020-04-28T12:58:47.324 INFO:teuthology.orchestra.run.smithi176.stdout: "email": "sysuser.client.0+test@test.test", 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "suspended": 0, 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "max_buckets": 1000, 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "subusers": [], 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "keys": [ 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "user": "sysuser.client.0", 2020-04-28T12:58:47.325 INFO:teuthology.orchestra.run.smithi176.stdout: "access_key": "LTVBYMUYCEPDMXKERCPC", 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: "secret_key": "Set+TuBoob8eLh4ovch2jFYZm1FGlmSxru2f9lMT+fQOwsmuefDbcg==" 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: "swift_keys": [], 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": [], 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: "op_mask": "read, write, delete", 2020-04-28T12:58:47.326 INFO:teuthology.orchestra.run.smithi176.stdout: "system": "true", 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "default_placement": "", 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "default_storage_class": "", 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "placement_tags": [], 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "bucket_quota": { 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T12:58:47.327 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "user_quota": { 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T12:58:47.328 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: "temp_url_keys": [], 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "rgw", 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: "mfa_ids": [] 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout:} 2020-04-28T12:58:47.329 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:47.330 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.319+0000 7f023ed6e180 20 remove_watcher() i=1 2020-04-28T12:58:47.331 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.320+0000 7f023ed6e180 20 remove_watcher() i=2 2020-04-28T12:58:47.331 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.321+0000 7f023ed6e180 20 remove_watcher() i=3 2020-04-28T12:58:47.332 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.322+0000 7f023ed6e180 20 remove_watcher() i=4 2020-04-28T12:58:47.333 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.324+0000 7f023ed6e180 20 remove_watcher() i=5 2020-04-28T12:58:47.333 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.325+0000 7f023ed6e180 20 remove_watcher() i=6 2020-04-28T12:58:47.333 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.326+0000 7f023ed6e180 20 remove_watcher() i=7 2020-04-28T12:58:47.335 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2020-04-28T12:58:47.335 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:47.349 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key SSAACGTVGBSTDWALHHOJ --secret 9L2ANh1LIgYjLJUsAZvKrH4b5YaFoPDHM6lP2HI2fXARw/Bkjs2EIA== --email ragweed.client.0+test@test.test --system false 2020-04-28T12:58:47.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.433+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.439 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.435+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.440 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.435+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.440 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.436+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.440 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.436+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.441 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.437+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.441 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.437+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.441 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.438+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.456 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T12:58:47.456 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T12:58:47.456 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:58:47.456 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:58:47.456 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.452+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.453+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.454+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 zonegroup default 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 10 Cannot find current period zone using local zone 2020-04-28T12:58:47.462 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.455+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.463 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.463 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:58:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:58:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 zone default found 2020-04-28T12:58:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.456+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.465 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.457+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.465 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.457+0000 7f5c8498f180 20 rados->read ofs=0 len=0 2020-04-28T12:58:47.465 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.457+0000 7f5c8498f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:58:47.465 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.457+0000 7f5c8498f180 20 started sync module instance, tier type = 2020-04-28T12:58:47.466 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.457+0000 7f5c8498f180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:58:47.466 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.460+0000 7f5c72978700 0 -- 172.21.15.176:0/3175391825 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7f5c68003550 msgr2=0x7f5c68003990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:58:47.472 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=0 2020-04-28T12:58:47.472 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=1 2020-04-28T12:58:47.472 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=2 2020-04-28T12:58:47.472 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=3 2020-04-28T12:58:47.473 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=4 2020-04-28T12:58:47.473 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=5 2020-04-28T12:58:47.473 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.467+0000 7f5c8498f180 20 add_watcher() i=6 2020-04-28T12:58:47.474 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.468+0000 7f5c8498f180 20 add_watcher() i=7 2020-04-28T12:58:47.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.468+0000 7f5c8498f180 2 all 8 watchers are set, enabling cache 2020-04-28T12:58:47.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.469+0000 7f5c8498f180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:58:47.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.469+0000 7f5c8498f180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:58:47.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.469+0000 7f5c437de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:58:47.476 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.469+0000 7f5c73179700 0 -- 172.21.15.176:0/958046261 >> v2:172.21.15.84:3300/0 conn(0x55f61dd75ef0 msgr2=0x55f61dd762f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:58:47.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.517+0000 7f5bb1ffb700 20 reqs_thread_entry: start 2020-04-28T12:58:47.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.517+0000 7f5bab7fe700 20 reqs_thread_entry: start 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.517+0000 7f5c8498f180 20 init_complete bucket index max shards: 1999 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5ba9ffb700 20 reqs_thread_entry: start 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 20 get_system_obj_state: rctx=0x7ffe825ef668 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55f61dc20170 s->prefetch_data=0 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:58:47.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 20 get_system_obj_state: rctx=0x7ffe825ef678 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x55f61dc20170 s->prefetch_data=0 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 20 get_system_obj_state: rctx=0x7ffe825ef678 obj=default.rgw.meta:users.keys:SSAACGTVGBSTDWALHHOJ state=0x55f61dc20170 s->prefetch_data=0 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.518+0000 7f5c8498f180 10 cache get: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ : miss 2020-04-28T12:58:47.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ info.flags=0x0 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 adding default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ to cache LRU end 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 20 get_system_obj_state: rctx=0x7ffe825ef088 obj=default.rgw.meta:users.keys:SSAACGTVGBSTDWALHHOJ state=0x55f61dc20170 s->prefetch_data=0 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 cache get: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ : type miss (requested=0x6, cached=0x0) 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ info.flags=0x0 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 moving default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ to cache LRU end 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 20 get_system_obj_state: rctx=0x7ffe825ef378 obj=default.rgw.meta:users.keys:SSAACGTVGBSTDWALHHOJ state=0x55f61dc20170 s->prefetch_data=0 2020-04-28T12:58:47.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.519+0000 7f5c8498f180 10 cache get: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ : type miss (requested=0x6, cached=0x0) 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.520+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ info.flags=0x0 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.520+0000 7f5c8498f180 10 moving default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ to cache LRU end 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c8498f180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c8498f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c53fff700 10 RGWWatcher::handle_notify() notify_id 502511173634 cookie 94515550903808 notifier 4849 bl.length()=637 2020-04-28T12:58:47.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c53fff700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.521+0000 7f5c53fff700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.523+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.523+0000 7f5c8498f180 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.523+0000 7f5c8498f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.524+0000 7f5c53fff700 10 RGWWatcher::handle_notify() notify_id 502511173633 cookie 94515550897056 notifier 4849 bl.length()=202 2020-04-28T12:58:47.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.524+0000 7f5c53fff700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:58:47.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.524+0000 7f5c53fff700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:58:47.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.525+0000 7f5c8498f180 10 cache put: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ info.flags=0x7 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.525+0000 7f5c8498f180 10 moving default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ to cache LRU end 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.525+0000 7f5c8498f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.526+0000 7f5c53fff700 10 RGWWatcher::handle_notify() notify_id 502511173635 cookie 94515550903808 notifier 4849 bl.length()=190 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.526+0000 7f5c53fff700 10 cache put: name=default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ info.flags=0x7 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.526+0000 7f5c53fff700 10 moving default.rgw.meta+users.keys+SSAACGTVGBSTDWALHHOJ to cache LRU end 2020-04-28T12:58:47.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.526+0000 7f5c437de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "user_id": "ragweed.client.0", 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "display_name": "Mr. ragweed.client.0", 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "email": "ragweed.client.0+test@test.test", 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "suspended": 0, 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "max_buckets": 1000, 2020-04-28T12:58:47.532 INFO:teuthology.orchestra.run.smithi176.stdout: "subusers": [], 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: "keys": [ 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: "user": "ragweed.client.0", 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: "access_key": "SSAACGTVGBSTDWALHHOJ", 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: "secret_key": "9L2ANh1LIgYjLJUsAZvKrH4b5YaFoPDHM6lP2HI2fXARw/Bkjs2EIA==" 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: } 2020-04-28T12:58:47.533 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "swift_keys": [], 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": [], 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "op_mask": "read, write, delete", 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "default_placement": "", 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "default_storage_class": "", 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "placement_tags": [], 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "bucket_quota": { 2020-04-28T12:58:47.534 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "user_quota": { 2020-04-28T12:58:47.535 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T12:58:47.536 INFO:teuthology.orchestra.run.smithi176.stdout: "temp_url_keys": [], 2020-04-28T12:58:47.537 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "rgw", 2020-04-28T12:58:47.537 INFO:teuthology.orchestra.run.smithi176.stdout: "mfa_ids": [] 2020-04-28T12:58:47.537 INFO:teuthology.orchestra.run.smithi176.stdout:} 2020-04-28T12:58:47.537 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:47.538 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.528+0000 7f5c8498f180 20 remove_watcher() i=0 2020-04-28T12:58:47.538 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.528+0000 7f5c8498f180 2 removed watcher, disabling cache 2020-04-28T12:58:47.539 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.529+0000 7f5c8498f180 20 remove_watcher() i=1 2020-04-28T12:58:47.539 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.530+0000 7f5c8498f180 20 remove_watcher() i=2 2020-04-28T12:58:47.539 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.531+0000 7f5c8498f180 20 remove_watcher() i=3 2020-04-28T12:58:47.539 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.532+0000 7f5c8498f180 20 remove_watcher() i=4 2020-04-28T12:58:47.539 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.534+0000 7f5c8498f180 20 remove_watcher() i=5 2020-04-28T12:58:47.540 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.535+0000 7f5c8498f180 20 remove_watcher() i=6 2020-04-28T12:58:47.540 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:58:47.536+0000 7f5c8498f180 20 remove_watcher() i=7 2020-04-28T12:58:47.545 INFO:tasks.ragweed:Configuring ragweed... 2020-04-28T12:58:47.545 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:58:47.559 INFO:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2020-04-28T12:58:50.598 INFO:teuthology.orchestra.run.smithi176.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2020-04-28T12:58:50.993 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:07:05 ago on Tue 28 Apr 2020 12:51:45 PM UTC. 2020-04-28T12:58:51.278 INFO:teuthology.orchestra.run.smithi176.stdout:Package python36-devel-3.6.8-2.module_el8.1.0+245+c39af44f.x86_64 is already installed. 2020-04-28T12:58:51.383 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2020-04-28T12:58:51.384 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:58:51.384 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2020-04-28T12:58:51.384 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:58:51.384 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2020-04-28T12:58:51.384 INFO:teuthology.orchestra.run.smithi176.stdout: libevent-devel x86_64 2.1.8-5.el8 CentOS-AppStream 104 k 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: libxml2-devel x86_64 2.9.7-5.el8 CentOS-AppStream 1.0 M 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: libxslt-devel x86_64 1.1.32-3.el8 CentOS-AppStream 322 k 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-10.el8 CentOS-Base 56 k 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: cmake-filesystem x86_64 3.11.4-3.el8 CentOS-AppStream 40 k 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: libgcrypt-devel x86_64 1.8.3-4.el8 CentOS-Base 149 k 2020-04-28T12:58:51.385 INFO:teuthology.orchestra.run.smithi176.stdout: libgpg-error-devel x86_64 1.31-1.el8 CentOS-Base 64 k 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout: xz-devel x86_64 5.2.4-3.el8 CentOS-Base 62 k 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout:Install 8 Packages 2020-04-28T12:58:51.386 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:51.387 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 1.8 M 2020-04-28T12:58:51.387 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 12 M 2020-04-28T12:58:51.387 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2020-04-28T12:58:51.417 INFO:teuthology.orchestra.run.smithi176.stdout:(1/8): cmake-filesystem-3.11.4-3.el8.x86_64.rpm 1.3 MB/s | 40 kB 00:00 2020-04-28T12:58:51.422 INFO:teuthology.orchestra.run.smithi176.stdout:(2/8): libevent-devel-2.1.8-5.el8.x86_64.rpm 2.9 MB/s | 104 kB 00:00 2020-04-28T12:58:51.424 INFO:teuthology.orchestra.run.smithi176.stdout:(3/8): libxslt-devel-1.1.32-3.el8.x86_64.rpm 47 MB/s | 322 kB 00:00 2020-04-28T12:58:51.426 INFO:teuthology.orchestra.run.smithi176.stdout:(4/8): libgpg-error-devel-1.31-1.el8.x86_64.rpm 31 MB/s | 64 kB 00:00 2020-04-28T12:58:51.427 INFO:teuthology.orchestra.run.smithi176.stdout:(5/8): libgcrypt-devel-1.8.3-4.el8.x86_64.rpm 35 MB/s | 149 kB 00:00 2020-04-28T12:58:51.428 INFO:teuthology.orchestra.run.smithi176.stdout:(6/8): xz-devel-5.2.4-3.el8.x86_64.rpm 45 MB/s | 62 kB 00:00 2020-04-28T12:58:51.429 INFO:teuthology.orchestra.run.smithi176.stdout:(7/8): zlib-devel-1.2.11-10.el8.x86_64.rpm 30 MB/s | 56 kB 00:00 2020-04-28T12:58:51.439 INFO:teuthology.orchestra.run.smithi176.stdout:(8/8): libxml2-devel-2.9.7-5.el8.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2020-04-28T12:58:51.441 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:58:51.442 INFO:teuthology.orchestra.run.smithi176.stdout:Total 32 MB/s | 1.8 MB 00:00 2020-04-28T12:58:51.450 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2020-04-28T12:58:51.461 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2020-04-28T12:58:51.462 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2020-04-28T12:58:51.599 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2020-04-28T12:58:51.599 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2020-04-28T12:58:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2020-04-28T12:58:52.120 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:58:52.142 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:58:52.295 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:58:52.307 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:58:52.491 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 3/8 2020-04-28T12:58:52.668 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xz-devel-5.2.4-3.el8.x86_64 4/8 2020-04-28T12:58:53.051 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cmake-filesystem-3.11.4-3.el8.x86_64 5/8 2020-04-28T12:58:53.386 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libxml2-devel-2.9.7-5.el8.x86_64 6/8 2020-04-28T12:58:53.642 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libxslt-devel-1.1.32-3.el8.x86_64 7/8 2020-04-28T12:58:53.851 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:58:54.078 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cmake-filesystem-3.11.4-3.el8.x86_64 1/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libevent-devel-2.1.8-5.el8.x86_64 2/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libxml2-devel-2.9.7-5.el8.x86_64 3/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libxslt-devel-1.1.32-3.el8.x86_64 4/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgcrypt-devel-1.8.3-4.el8.x86_64 5/8 2020-04-28T12:58:54.079 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgpg-error-devel-1.31-1.el8.x86_64 6/8 2020-04-28T12:58:54.080 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xz-devel-5.2.4-3.el8.x86_64 7/8 2020-04-28T12:58:54.461 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 8/8 2020-04-28T12:58:54.461 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:54.461 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: libevent-devel-2.1.8-5.el8.x86_64 libxml2-devel-2.9.7-5.el8.x86_64 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: libxslt-devel-1.1.32-3.el8.x86_64 zlib-devel-1.2.11-10.el8.x86_64 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: cmake-filesystem-3.11.4-3.el8.x86_64 libgcrypt-devel-1.8.3-4.el8.x86_64 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: libgpg-error-devel-1.31-1.el8.x86_64 xz-devel-5.2.4-3.el8.x86_64 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:58:54.462 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2020-04-28T12:58:55.649 INFO:teuthology.orchestra.run.smithi176.stdout:Using base prefix '/usr' 2020-04-28T12:58:55.649 INFO:teuthology.orchestra.run.smithi176.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python3 2020-04-28T12:58:55.649 INFO:teuthology.orchestra.run.smithi176.stdout:Also creating executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2020-04-28T12:58:58.422 INFO:teuthology.orchestra.run.smithi176.stdout:Installing setuptools, pip, wheel...done. 2020-04-28T12:58:58.430 INFO:teuthology.orchestra.run.smithi176.stdout:Running virtualenv with interpreter /usr/bin/python3 2020-04-28T12:58:58.979 INFO:teuthology.orchestra.run.smithi176.stdout:Requirement already up-to-date: pip in ./virtualenv/lib/python3.6/site-packages (20.0.2) 2020-04-28T12:58:59.738 INFO:teuthology.orchestra.run.smithi176.stdout:Requirement already satisfied: six in /usr/lib/python3.6/site-packages (1.11.0) 2020-04-28T12:59:00.398 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting nose 2020-04-28T12:59:00.441 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2020-04-28T12:59:00.615 INFO:teuthology.orchestra.run.smithi176.stdout:Installing collected packages: nose 2020-04-28T12:59:00.696 INFO:teuthology.orchestra.run.smithi176.stdout:Successfully installed nose-1.3.7 2020-04-28T12:59:01.139 INFO:teuthology.orchestra.run.smithi176.stdout:Requirement already satisfied: setuptools in ./virtualenv/lib/python3.6/site-packages (46.1.3) 2020-04-28T12:59:01.899 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting PyYAML 2020-04-28T12:59:01.943 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading PyYAML-5.3.1.tar.gz (269 kB) 2020-04-28T12:59:02.459 INFO:teuthology.orchestra.run.smithi176.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2020-04-28T12:59:02.587 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting boto!=2.46.0,>=2.6.0 2020-04-28T12:59:02.597 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2020-04-28T12:59:02.888 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting munch>=1.0.0 2020-04-28T12:59:02.896 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading munch-2.5.0-py2.py3-none-any.whl (10 kB) 2020-04-28T12:59:03.195 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting gevent>=1.0 2020-04-28T12:59:03.204 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading gevent-20.4.0-cp36-cp36m-manylinux2010_x86_64.whl (5.1 MB) 2020-04-28T12:59:03.674 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting httplib2 2020-04-28T12:59:03.683 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading httplib2-0.17.3-py3-none-any.whl (95 kB) 2020-04-28T12:59:04.303 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting lxml 2020-04-28T12:59:04.317 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading lxml-4.5.0-cp36-cp36m-manylinux1_x86_64.whl (5.8 MB) 2020-04-28T12:59:04.616 INFO:teuthology.orchestra.run.smithi176.stdout:Requirement already satisfied, skipping upgrade: six in /usr/lib/python3.6/site-packages (from munch>=1.0.0->-r requirements.txt (line 4)) (1.11.0) 2020-04-28T12:59:04.738 INFO:teuthology.orchestra.run.smithi176.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2020-04-28T12:59:04.747 INFO:teuthology.orchestra.run.smithi176.stdout: Downloading greenlet-0.4.15-cp36-cp36m-manylinux1_x86_64.whl (41 kB) 2020-04-28T12:59:04.805 INFO:teuthology.orchestra.run.smithi176.stdout:Building wheels for collected packages: PyYAML 2020-04-28T12:59:04.805 INFO:teuthology.orchestra.run.smithi176.stdout: Building wheel for PyYAML (setup.py): started 2020-04-28T12:59:05.291 INFO:teuthology.orchestra.run.smithi176.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2020-04-28T12:59:05.292 INFO:teuthology.orchestra.run.smithi176.stdout: Created wheel for PyYAML: filename=PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl size=44621 sha256=c6351099e0eecf876592360043b9f1dd0a06afc5dda9acf84bcb4ea7a82d04b3 2020-04-28T12:59:05.292 INFO:teuthology.orchestra.run.smithi176.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/e5/9d/ad/2ee53cf262cba1ffd8afe1487eef788ea3f260b7e6232a80fc 2020-04-28T12:59:05.292 INFO:teuthology.orchestra.run.smithi176.stdout:Successfully built PyYAML 2020-04-28T12:59:05.474 INFO:teuthology.orchestra.run.smithi176.stdout:Installing collected packages: PyYAML, boto, munch, greenlet, gevent, httplib2, lxml 2020-04-28T12:59:05.474 INFO:teuthology.orchestra.run.smithi176.stdout: Attempting uninstall: PyYAML 2020-04-28T12:59:05.475 INFO:teuthology.orchestra.run.smithi176.stdout: Found existing installation: PyYAML 3.12 2020-04-28T12:59:05.475 INFO:teuthology.orchestra.run.smithi176.stdout: Not uninstalling pyyaml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:59:05.475 INFO:teuthology.orchestra.run.smithi176.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2020-04-28T12:59:06.529 INFO:teuthology.orchestra.run.smithi176.stdout: Attempting uninstall: lxml 2020-04-28T12:59:06.529 INFO:teuthology.orchestra.run.smithi176.stdout: Found existing installation: lxml 4.2.3 2020-04-28T12:59:06.530 INFO:teuthology.orchestra.run.smithi176.stdout: Not uninstalling lxml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:59:06.530 INFO:teuthology.orchestra.run.smithi176.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2020-04-28T12:59:06.696 INFO:teuthology.orchestra.run.smithi176.stdout:Successfully installed PyYAML-5.3.1 boto-2.49.0 gevent-20.4.0 greenlet-0.4.15 httplib2-0.17.3 lxml-4.5.0 munch-2.5.0 2020-04-28T12:59:07.028 INFO:teuthology.orchestra.run.smithi176.stdout:running develop 2020-04-28T12:59:07.060 INFO:teuthology.orchestra.run.smithi176.stdout:running egg_info 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:creating ragweed.egg-info 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:writing ragweed.egg-info/PKG-INFO 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:writing requirements to ragweed.egg-info/requires.txt 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2020-04-28T12:59:07.061 INFO:teuthology.orchestra.run.smithi176.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:59:07.072 INFO:teuthology.orchestra.run.smithi176.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:59:07.074 INFO:teuthology.orchestra.run.smithi176.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:59:07.074 INFO:teuthology.orchestra.run.smithi176.stdout:running build_ext 2020-04-28T12:59:07.074 INFO:teuthology.orchestra.run.smithi176.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/ragweed.egg-link (link to .) 2020-04-28T12:59:07.075 INFO:teuthology.orchestra.run.smithi176.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2020-04-28T12:59:07.075 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.075 INFO:teuthology.orchestra.run.smithi176.stdout:Installed /home/ubuntu/cephtest/ragweed 2020-04-28T12:59:07.076 INFO:teuthology.orchestra.run.smithi176.stdout:Processing dependencies for ragweed==0.0.1 2020-04-28T12:59:07.078 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for isodate>=0.4.4 2020-04-28T12:59:07.078 INFO:teuthology.orchestra.run.smithi176.stdout:Reading https://pypi.org/simple/isodate/ 2020-04-28T12:59:07.127 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl#sha256=aa4d33c06640f5352aca96e4b81afd8ab3b47337cc12089822d6f322ac772c81 2020-04-28T12:59:07.185 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: isodate 0.6.0 2020-04-28T12:59:07.186 INFO:teuthology.orchestra.run.smithi176.stdout:Processing isodate-0.6.0-py2.py3-none-any.whl 2020-04-28T12:59:07.186 INFO:teuthology.orchestra.run.smithi176.stdout:Installing isodate-0.6.0-py2.py3-none-any.whl to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.193 INFO:teuthology.orchestra.run.smithi176.stdout:Adding isodate 0.6.0 to easy-install.pth file 2020-04-28T12:59:07.194 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.194 INFO:teuthology.orchestra.run.smithi176.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/isodate-0.6.0-py3.6.egg 2020-04-28T12:59:07.244 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for gevent==20.4.0 2020-04-28T12:59:07.245 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: gevent 20.4.0 2020-04-28T12:59:07.245 INFO:teuthology.orchestra.run.smithi176.stdout:Adding gevent 20.4.0 to easy-install.pth file 2020-04-28T12:59:07.245 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.245 INFO:teuthology.orchestra.run.smithi176.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.246 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for munch==2.5.0 2020-04-28T12:59:07.246 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: munch 2.5.0 2020-04-28T12:59:07.246 INFO:teuthology.orchestra.run.smithi176.stdout:Adding munch 2.5.0 to easy-install.pth file 2020-04-28T12:59:07.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for PyYAML==5.3.1 2020-04-28T12:59:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: PyYAML 5.3.1 2020-04-28T12:59:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:Adding PyYAML 5.3.1 to easy-install.pth file 2020-04-28T12:59:07.248 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.248 INFO:teuthology.orchestra.run.smithi176.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.248 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for boto==2.49.0 2020-04-28T12:59:07.248 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: boto 2.49.0 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Adding boto 2.49.0 to easy-install.pth file 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for six==1.11.0 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: six 1.11.0 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Adding six 1.11.0 to easy-install.pth file 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.249 INFO:teuthology.orchestra.run.smithi176.stdout:Using /usr/lib/python3.6/site-packages 2020-04-28T12:59:07.250 INFO:teuthology.orchestra.run.smithi176.stdout:Searching for greenlet==0.4.15 2020-04-28T12:59:07.250 INFO:teuthology.orchestra.run.smithi176.stdout:Best match: greenlet 0.4.15 2020-04-28T12:59:07.251 INFO:teuthology.orchestra.run.smithi176.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2020-04-28T12:59:07.251 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T12:59:07.251 INFO:teuthology.orchestra.run.smithi176.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:59:07.251 INFO:teuthology.orchestra.run.smithi176.stdout:Finished processing dependencies for ragweed==0.0.1 2020-04-28T12:59:07.269 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:07.283 INFO:teuthology.orchestra.run.smithi176:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2020-04-28T12:59:07.367 INFO:tasks.ragweed:Configuring boto... 2020-04-28T12:59:07.368 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:07.421 INFO:teuthology.orchestra.run.smithi176:> cat > /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:59:07.505 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:07.559 INFO:teuthology.orchestra.run.smithi176:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2020-04-28T12:59:11.534 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2020-04-28T12:59:12.882 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2020-04-28T12:59:13.943 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2020-04-28T12:59:15.038 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2020-04-28T12:59:19.538 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2020-04-28T12:59:21.626 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2020-04-28T12:59:23.886 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2020-04-28T12:59:26.876 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2020-04-28T12:59:29.018 INFO:teuthology.orchestra.run.smithi176.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2020-04-28T12:59:29.018 INFO:teuthology.orchestra.run.smithi176.stderr: 2020-04-28T12:59:29.018 INFO:teuthology.orchestra.run.smithi176.stderr:---------------------------------------------------------------------- 2020-04-28T12:59:29.018 INFO:teuthology.orchestra.run.smithi176.stderr:Ran 9 tests in 21.170s 2020-04-28T12:59:29.019 INFO:teuthology.orchestra.run.smithi176.stderr: 2020-04-28T12:59:29.019 INFO:teuthology.orchestra.run.smithi176.stderr:OK 2020-04-28T12:59:29.045 INFO:tasks.ragweed:Cleaning up boto... 2020-04-28T12:59:29.046 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:29.059 INFO:teuthology.orchestra.run.smithi176:> rm /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:59:29.112 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:29.165 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2020-04-28T12:59:29.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.242+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.243+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.243+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.244+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.244+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.245+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.245+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.245+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.259+0000 7f8af6ce6180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T12:59:29.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.259+0000 7f8af6ce6180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T12:59:29.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.259+0000 7f8af6ce6180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:59:29.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.259+0000 7f8af6ce6180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:59:29.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.259+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.266 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.260+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.266 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.260+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.260+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:59:29.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.260+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.261+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.262+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.262+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.262+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.262+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 zonegroup default 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 10 Cannot find current period zone using local zone 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.263+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 zone default found 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.264+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.265+0000 7f8af6ce6180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.265+0000 7f8af6ce6180 20 started sync module instance, tier type = 2020-04-28T12:59:29.272 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.265+0000 7f8af6ce6180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:59:29.273 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.266+0000 7f8ae44ce700 0 -- 172.21.15.176:0/760470200 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x556024ae6820 msgr2=0x556024ae8ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:29.282 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.277+0000 7f8af6ce6180 20 add_watcher() i=0 2020-04-28T12:59:29.282 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.277+0000 7f8af6ce6180 20 add_watcher() i=1 2020-04-28T12:59:29.283 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.277+0000 7f8af6ce6180 20 add_watcher() i=2 2020-04-28T12:59:29.283 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.277+0000 7f8af6ce6180 20 add_watcher() i=3 2020-04-28T12:59:29.283 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.277+0000 7f8af6ce6180 20 add_watcher() i=4 2020-04-28T12:59:29.287 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 20 add_watcher() i=5 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 20 add_watcher() i=6 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 20 add_watcher() i=7 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 2 all 8 watchers are set, enabling cache 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8af6ce6180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:59:29.288 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.282+0000 7f8ab57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:59:29.289 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.283+0000 7f8ae44ce700 0 -- 172.21.15.176:0/2007184547 >> v2:172.21.15.84:3300/0 conn(0x556024b066b0 msgr2=0x556024b08aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:59:29.338 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8a277fe700 20 reqs_thread_entry: start 2020-04-28T12:59:29.338 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8a257fa700 20 reqs_thread_entry: start 2020-04-28T12:59:29.338 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8af6ce6180 20 init_complete bucket index max shards: 1999 2020-04-28T12:59:29.338 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8a137fe700 20 reqs_thread_entry: start 2020-04-28T12:59:29.338 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8af6ce6180 20 get_system_obj_state: rctx=0x7ffc8ceb3588 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5560249ad170 s->prefetch_data=0 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.332+0000 7f8af6ce6180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:29.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:59:29.340 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.340 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:59:29.340 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2020-04-28T12:59:29.341 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.333+0000 7f8af6ce6180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:59:29.341 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.334+0000 7f8af6ce6180 10 removing key index: LTVBYMUYCEPDMXKERCPC 2020-04-28T12:59:29.341 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.334+0000 7f8af6ce6180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2020-04-28T12:59:29.341 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.334+0000 7f8ada7fc700 10 RGWWatcher::handle_notify() notify_id 536870912004 cookie 93871420639584 notifier 4870 bl.length()=170 2020-04-28T12:59:29.342 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.336+0000 7f8af6ce6180 10 removing email index: sysuser.client.0+test@test.test 2020-04-28T12:59:29.342 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.336+0000 7f8af6ce6180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2020-04-28T12:59:29.342 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.336+0000 7f8ada7fc700 10 RGWWatcher::handle_notify() notify_id 536870912005 cookie 93871420639584 notifier 4870 bl.length()=182 2020-04-28T12:59:29.343 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.338+0000 7f8af6ce6180 10 removing user buckets index 2020-04-28T12:59:29.343 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.338+0000 7f8af6ce6180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2020-04-28T12:59:29.343 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.338+0000 7f8ada7fc700 10 RGWWatcher::handle_notify() notify_id 536870912000 cookie 93871420635760 notifier 4870 bl.length()=173 2020-04-28T12:59:29.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.340+0000 7f8af6ce6180 10 removing user index: sysuser.client.0 2020-04-28T12:59:29.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.340+0000 7f8af6ce6180 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2020-04-28T12:59:29.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.340+0000 7f8af6ce6180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2020-04-28T12:59:29.346 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.341+0000 7f8ada7fc700 10 RGWWatcher::handle_notify() notify_id 536870912002 cookie 93871420632272 notifier 4870 bl.length()=165 2020-04-28T12:59:29.347 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.342+0000 7f8ab57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:59:29.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.344+0000 7f8af6ce6180 20 remove_watcher() i=0 2020-04-28T12:59:29.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.344+0000 7f8af6ce6180 2 removed watcher, disabling cache 2020-04-28T12:59:29.350 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.345+0000 7f8af6ce6180 20 remove_watcher() i=1 2020-04-28T12:59:29.351 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.346+0000 7f8af6ce6180 20 remove_watcher() i=2 2020-04-28T12:59:29.352 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.347+0000 7f8af6ce6180 20 remove_watcher() i=3 2020-04-28T12:59:29.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.348+0000 7f8af6ce6180 20 remove_watcher() i=4 2020-04-28T12:59:29.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.349+0000 7f8af6ce6180 20 remove_watcher() i=5 2020-04-28T12:59:29.356 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.351+0000 7f8af6ce6180 20 remove_watcher() i=6 2020-04-28T12:59:29.357 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.352+0000 7f8af6ce6180 20 remove_watcher() i=7 2020-04-28T12:59:29.361 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:29.416 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2020-04-28T12:59:29.496 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.491+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.498 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.493+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.498 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.493+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.499 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.494+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.499 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.494+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.499 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.494+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.499 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.494+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.500 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.495+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.514 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.509+0000 7efe0649d180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T12:59:29.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.509+0000 7efe0649d180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T12:59:29.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.509+0000 7efe0649d180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:59:29.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.509+0000 7efe0649d180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:59:29.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.509+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.519 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.519 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.510+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.511+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.511+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.511+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.511+0000 7efe0649d180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.511+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 zonegroup default 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.512+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 10 Cannot find current period zone using local zone 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.513+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efe0649d180 20 zone default found 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efdec03e630 msgr2=0x7efdec03e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:29.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.514+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.515+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:29.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.515+0000 7efe0649d180 20 started sync module instance, tier type = 2020-04-28T12:59:29.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.515+0000 7efe0649d180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=0 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=1 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=2 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=3 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=4 2020-04-28T12:59:29.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=5 2020-04-28T12:59:29.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.525+0000 7efe0649d180 20 add_watcher() i=6 2020-04-28T12:59:29.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.526+0000 7efe0649d180 20 add_watcher() i=7 2020-04-28T12:59:29.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.526+0000 7efe0649d180 2 all 8 watchers are set, enabling cache 2020-04-28T12:59:29.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.526+0000 7efe0649d180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:59:29.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.526+0000 7efe0649d180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:59:29.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.526+0000 7efdc4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:59:29.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.527+0000 7efdf3c85700 0 -- 172.21.15.176:0/2997746628 >> v2:172.21.15.176:3300/0 conn(0x561f7d95a110 msgr2=0x561f7d960a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:59:29.582 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.576+0000 7efd36ffd700 20 reqs_thread_entry: start 2020-04-28T12:59:29.582 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efd34ff9700 20 reqs_thread_entry: start 2020-04-28T12:59:29.583 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 20 init_complete bucket index max shards: 1999 2020-04-28T12:59:29.583 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efd2affd700 20 reqs_thread_entry: start 2020-04-28T12:59:29.583 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f71128 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:29.583 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:59:29.584 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2020-04-28T12:59:29.584 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:59:29.584 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:29.584 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:29.584 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.577+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.578+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.578+0000 7efe0649d180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.578+0000 7efe0649d180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-conf state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:29.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2020-04-28T12:59:29.587 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2020-04-28T12:59:29.587 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:59:29.587 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:29.587 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.579+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=200 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:59:29.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 : miss 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 info.flags=0x16 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 to cache LRU end 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:29.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.580+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=293 2020-04-28T12:59:29.590 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 info.flags=0x13 2020-04-28T12:59:29.591 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 to cache LRU end 2020-04-28T12:59:29.591 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:29.591 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:29.591 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.581+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 2020-04-28T12:59:29.707 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.702+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-conf[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1]) start_after [] num_entries 1100 2020-04-28T12:59:29.790 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.785+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2020-04-28T12:59:29.818 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.813+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2020-04-28T12:59:29.974 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.969+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x561f7d9383d0 msgr2=0x561f7d93a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:29.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.980+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde005c7a0 msgr2=0x7efde005ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:29.989 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:29.984+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x561f7d9383d0 msgr2=0x7efde0069210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.115 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.110+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde005c7a0 msgr2=0x7efde005eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.296 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.290+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2020-04-28T12:59:30.305 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.300+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2020-04-28T12:59:30.364 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.359+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2020-04-28T12:59:30.465 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.455+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2020-04-28T12:59:30.478 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.473+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2020-04-28T12:59:30.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.591+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2020-04-28T12:59:30.652 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.647+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2020-04-28T12:59:30.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.730+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.731+0000 7efe0649d180 10 manifest: total_size = 12651 2020-04-28T12:59:30.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.731+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.56 2020-04-28T12:59:30.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.731+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.731+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7daa5708 2020-04-28T12:59:30.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.731+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.162 2020-04-28T12:59:30.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : miss 2020-04-28T12:59:30.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : miss 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.734+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 10 manifest: total_size = 4851 2020-04-28T12:59:30.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.30 2020-04-28T12:59:30.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7daa5708 2020-04-28T12:59:30.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.735+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.215 2020-04-28T12:59:30.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.738+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.738+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 10 manifest: total_size = 12913 2020-04-28T12:59:30.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.13 2020-04-28T12:59:30.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7daa5708 2020-04-28T12:59:30.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.739+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1143 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.742+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.742+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 10 manifest: total_size = 7682 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.247 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7daa5708 2020-04-28T12:59:30.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.743+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1162 2020-04-28T12:59:30.754 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.746+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.746+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.755 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.747+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.748+0000 7efe0649d180 10 manifest: total_size = 15757 2020-04-28T12:59:30.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.748+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.120 2020-04-28T12:59:30.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.748+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561f7daa5708 s->prefetch_data=0 2020-04-28T12:59:30.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.748+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7daa5708 2020-04-28T12:59:30.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.748+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1273 2020-04-28T12:59:30.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.750+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.750+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.751+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.752+0000 7efe0649d180 10 manifest: total_size = 14036 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.752+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.190 2020-04-28T12:59:30.760 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.752+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.761 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.752+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db772c8 2020-04-28T12:59:30.761 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.752+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1462 2020-04-28T12:59:30.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.754+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.754+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.755+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.756+0000 7efe0649d180 10 manifest: total_size = 4756 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.756+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.72 2020-04-28T12:59:30.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.756+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.765 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.756+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db772c8 2020-04-28T12:59:30.765 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.756+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1499 2020-04-28T12:59:30.766 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.758+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.766 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.758+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.766 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.766 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.767 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.759+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.760+0000 7efe0649d180 10 manifest: total_size = 8646 2020-04-28T12:59:30.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.760+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.323 2020-04-28T12:59:30.769 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.760+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.769 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.760+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db772c8 2020-04-28T12:59:30.769 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.760+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1735 2020-04-28T12:59:30.770 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.762+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.770 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.762+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.770 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.763+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.764+0000 7efe0649d180 10 manifest: total_size = 4922 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.764+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.87 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.764+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561f7db772c8 s->prefetch_data=0 2020-04-28T12:59:30.772 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.764+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db772c8 2020-04-28T12:59:30.773 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.764+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1.1841 2020-04-28T12:59:30.774 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.766+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.774 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.766+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.774 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.774 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.774 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:59:30.775 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:30.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:30.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:30.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:30.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.767+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-conf[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:30.776 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.768+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:30.786 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.781+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde005c7a0 msgr2=0x7efde005eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.861 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.856+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde005c7a0 msgr2=0x7efde00704b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.876+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x561f7d9383d0 msgr2=0x7efde0069210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.880+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:30.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.880+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:30.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.880+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:30.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.880+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:30.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.909+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0063d20 msgr2=0x7efde0066da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:30.980 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.975+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0063d20 msgr2=0x7efde00669d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:30.998 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-conf state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:30.998 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:30.999 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2020-04-28T12:59:30.999 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-conf from cache 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.993+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2020-04-28T12:59:31.000 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.994+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912000 cookie 94693249416128 notifier 4728 bl.length()=162 2020-04-28T12:59:31.001 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.996+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.1 from cache 2020-04-28T12:59:31.001 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.996+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=219 2020-04-28T12:59:31.001 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:30.996+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912001 cookie 94693250870432 notifier 4728 bl.length()=219 2020-04-28T12:59:31.376 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.371+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:31.376 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.371+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:31.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=229 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 : miss 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 info.flags=0x16 2020-04-28T12:59:31.379 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 to cache LRU end 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:31.380 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:31.381 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.372+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:31.381 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=322 2020-04-28T12:59:31.381 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 info.flags=0x13 2020-04-28T12:59:31.381 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 to cache LRU end 2020-04-28T12:59:31.382 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:31.382 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:31.382 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.373+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 2020-04-28T12:59:31.443 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.438+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efdec03e630 msgr2=0x7efde0061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:31.495 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.490+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2]) start_after [] num_entries 1100 2020-04-28T12:59:31.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.860+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde80056e0 msgr2=0x7efde006b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:31.989 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:31.984+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x561f7d9383d0 msgr2=0x7efde0072c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:32.105 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.100+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:59:32.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.512+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561f7da7e8d8 s->prefetch_data=0 2020-04-28T12:59:32.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.513+0000 7efe0649d180 10 manifest: total_size = 18874368 2020-04-28T12:59:32.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.513+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.20 2020-04-28T12:59:32.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.513+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561f7da7e8d8 s->prefetch_data=0 2020-04-28T12:59:32.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.513+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7da7e8d8 2020-04-28T12:59:32.518 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.513+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2.1201 2020-04-28T12:59:32.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:59:32.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:32.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:32.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:59:32.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:59:32.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:59:32.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:32.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:59:32.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2020-04-28T12:59:32.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.516+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.20 2020-04-28T12:59:32.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.518+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:32.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.518+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:32.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.519+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:32.592 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.587+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0063d20 msgr2=0x7efde0075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.594 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.589+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x561f7d93fad0 msgr2=0x7efde0074890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.600 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.595+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x561f7d93b9d0 msgr2=0x7efde0063880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.635 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.630+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0074cf0 msgr2=0x7efde0075850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.636 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.631+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:32.636 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.631+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:32.637 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.632+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:32.637 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.632+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:32.669 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.664+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x561f7d93b9d0 msgr2=0x7efde0073e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.673 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.667+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x561f7d9383d0 msgr2=0x7efde0063570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.710+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde0074890 msgr2=0x7efde00737c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:32.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.722+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde80056e0 msgr2=0x7efde0072e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:32.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.723+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x561f7d9383d0 msgr2=0x7efde0072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.734 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.729+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074890 msgr2=0x7efde0072870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.732+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b1e0 msgr2=0x7efde0072d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:32.756 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:32.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2020-04-28T12:59:32.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:59:32.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:32.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:32.757 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:32.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2020-04-28T12:59:32.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.751+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2020-04-28T12:59:32.758 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.752+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912006 cookie 94693250866560 notifier 4728 bl.length()=191 2020-04-28T12:59:32.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.753+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2 from cache 2020-04-28T12:59:32.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.753+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=248 2020-04-28T12:59:32.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.754+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912001 cookie 94693250880560 notifier 4728 bl.length()=248 2020-04-28T12:59:32.843 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.838+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde8017180 msgr2=0x7efde0074430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:32.993 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:32.988+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde400d250 msgr2=0x7efde0075110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:33.128 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.123+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efdec03e630 msgr2=0x7efde0061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.141 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:33.141 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:59:33.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.136+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:33.143 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=236 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 : miss 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 info.flags=0x16 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 to cache LRU end 2020-04-28T12:59:33.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:33.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:33.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:33.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:33.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:33.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:33.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.137+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:33.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=329 2020-04-28T12:59:33.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 info.flags=0x13 2020-04-28T12:59:33.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 to cache LRU end 2020-04-28T12:59:33.147 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:33.147 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:33.147 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.138+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 2020-04-28T12:59:33.205 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.198+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde005c7a0 msgr2=0x7efde0064120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.202+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde005ec20 msgr2=0x7efde0072870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.236 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.231+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074cf0 msgr2=0x7efde0075850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.268 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.263+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005ec20 msgr2=0x7efde0072870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.273 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.268+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3]) start_after [] num_entries 1100 2020-04-28T12:59:33.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.871+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0072cd0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:33.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:33.883+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:59:34.207 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.202+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0073e80 msgr2=0x7efde006ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.237 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.232+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde8017180 msgr2=0x7efde0074400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:34.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 10 manifest: total_size = 886297 2020-04-28T12:59:34.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.40 2020-04-28T12:59:34.304 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:34.304 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc14438 2020-04-28T12:59:34.304 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.298+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3.1201 2020-04-28T12:59:34.306 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.301+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:59:34.306 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.301+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:34.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:59:34.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2020-04-28T12:59:34.310 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2020-04-28T12:59:34.311 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2020-04-28T12:59:34.311 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2020-04-28T12:59:34.311 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2020-04-28T12:59:34.311 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.302+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.40 2020-04-28T12:59:34.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.303+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:34.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.303+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-update-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:34.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.304+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:34.337 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.332+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.383 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.378+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde400d250 msgr2=0x7efde0075110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.591 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.586+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.586+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.586+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:34.592 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.586+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:34.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.618+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde8017180 msgr2=0x7efde0074400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.626+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde0073e80 msgr2=0x7efde006ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.640 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.635+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.642 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.638+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0072cd0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.670 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.665+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.701 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:34.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:34.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2020-04-28T12:59:34.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.697+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912003 cookie 94693250868592 notifier 4728 bl.length()=198 2020-04-28T12:59:34.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.699+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3 from cache 2020-04-28T12:59:34.705 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.699+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=255 2020-04-28T12:59:34.705 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.700+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912002 cookie 94693250878576 notifier 4728 bl.length()=255 2020-04-28T12:59:34.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.743+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde8017180 msgr2=0x7efde0074400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:34.980 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:34.975+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074cf0 msgr2=0x7efde007a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.088 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.083+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:35.088 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.083+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:59:35.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2020-04-28T12:59:35.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:35.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=231 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2020-04-28T12:59:35.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.084+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 : miss 2020-04-28T12:59:35.091 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 info.flags=0x16 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 to cache LRU end 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:35.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=324 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 info.flags=0x13 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 to cache LRU end 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:35.093 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.085+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 2020-04-28T12:59:35.110 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.105+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde005ec20 msgr2=0x7efde0072830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.112 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.107+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.132+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde0074cf0 msgr2=0x7efde006ff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.171 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.166+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde8017180 msgr2=0x7efde00638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.202+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4]) start_after [] num_entries 1100 2020-04-28T12:59:35.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.738+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde005ec20 msgr2=0x7efde0072830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.833 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.828+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo[7h8Unl2MghOMcOnrR28YzrHBq3q6DK3] 2020-04-28T12:59:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.898+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0074cf0 msgr2=0x7efde0073590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.952 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.947+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde8017180 msgr2=0x7efde0063830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:35.982 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:35.977+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0077dd0 msgr2=0x7efde006a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.234+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.234+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:36.240 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.235+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to suga4mu6z80asvqk270qhois1gpu2er9 2020-04-28T12:59:36.240 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.235+0000 7efe0649d180 20 get_obj_state_impl: setting s->olh_tag to yf5sj7j229zojzz4qrkznafiza58q258 2020-04-28T12:59:36.240 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.235+0000 7efe0649d180 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yf5sj7j229zojzz4qrkznafiza58q258 2020-04-28T12:59:36.241 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.236+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.238+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.238+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.238+0000 7efe0649d180 20 olh_log_entry: epoch=3 op=2 key=[] 2020-04-28T12:59:36.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.238+0000 7efe0649d180 20 olh_log_entry: epoch=3 op=3 key=foo[7h8Unl2MghOMcOnrR28YzrHBq3q6DK3] 2020-04-28T12:59:36.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.238+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:7h8Unl2MghOMcOnrR28YzrHBq3q6DK3_foo state=0x561f7db1d0d8 s->prefetch_data=0 2020-04-28T12:59:36.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.239+0000 7efe0649d180 10 manifest: total_size = 1848 2020-04-28T12:59:36.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.239+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.55 2020-04-28T12:59:36.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.239+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:7h8Unl2MghOMcOnrR28YzrHBq3q6DK3_foo state=0x561f7db1d0d8 s->prefetch_data=0 2020-04-28T12:59:36.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.239+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db1d0d8 2020-04-28T12:59:36.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.239+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:59:36.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:36.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:59:36.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:36.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:59:36.249 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.242+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:36.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:59:36.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:36.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:36.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:36.251 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:36.251 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:59:36.251 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:59:36.251 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:59:36.252 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:59:36.252 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:59:36.252 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2020-04-28T12:59:36.252 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:59:36.253 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=515 2020-04-28T12:59:36.253 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2020-04-28T12:59:36.253 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2020-04-28T12:59:36.253 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6293001 part_ofs=1545 rule->part_size=303 2020-04-28T12:59:36.254 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2020-04-28T12:59:36.254 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.243+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.55 2020-04-28T12:59:36.256 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.245+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.256 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.245+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.256 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.248+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.256 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.249+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4.1201 2020-04-28T12:59:36.257 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.249+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:36.257 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.249+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.257 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:36.258 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:59:36.258 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:36.258 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:36.258 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:36.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:59:36.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:36.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:36.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:36.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:36.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:36.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.250+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-index-versioning.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:36.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.251+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:36.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.308+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0072cd0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.321 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.316+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde0077dd0 msgr2=0x7efde007a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.365 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.360+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:36.366 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.360+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:36.366 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.360+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:36.366 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.360+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:36.378 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.373+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0072410 msgr2=0x7efde0074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.392 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.387+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde006ad80 msgr2=0x7efde007b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.406 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.401+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:36.413 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.408+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde0077dd0 msgr2=0x7efde007a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.454+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074260 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.465+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0077dd0 msgr2=0x7efde007a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.470+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:36.475 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.470+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:36.476 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2020-04-28T12:59:36.476 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:59:36.476 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:36.477 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:36.477 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:36.477 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2020-04-28T12:59:36.477 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2020-04-28T12:59:36.477 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.471+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912004 cookie 94693250868592 notifier 4728 bl.length()=193 2020-04-28T12:59:36.478 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.473+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4 from cache 2020-04-28T12:59:36.478 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.473+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=250 2020-04-28T12:59:36.479 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.474+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912003 cookie 94693250881600 notifier 4728 bl.length()=250 2020-04-28T12:59:36.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.540+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0074260 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.734 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.729+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074260 msgr2=0x7efde007e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.739+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007d040 msgr2=0x7efde007a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.812+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074260 msgr2=0x7efde007a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.864 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.858+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:36.864 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.858+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:59:36.864 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.865 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:59:36.866 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2020-04-28T12:59:36.866 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:59:36.866 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:36.866 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 : miss 2020-04-28T12:59:36.867 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 info.flags=0x16 2020-04-28T12:59:36.867 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 to cache LRU end 2020-04-28T12:59:36.868 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:36.868 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:36.868 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.859+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:59:36.869 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 info.flags=0x13 2020-04-28T12:59:36.870 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 to cache LRU end 2020-04-28T12:59:36.870 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:36.870 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:36.870 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.860+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 2020-04-28T12:59:36.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.905+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.936+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.937+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0075850 msgr2=0x7efde007b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.938+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007d040 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:36.949 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.944+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0077dd0 msgr2=0x7efde00738b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:36.993 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:36.988+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5]) start_after [] num_entries 1100 2020-04-28T12:59:37.116 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.111+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.123 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.118+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde007d040 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:37.197 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.192+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0077dd0 msgr2=0x7efde0061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.229 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.224+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.335 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.330+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.451 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.446+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde0072cd0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.467 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.462+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde007a1c0 msgr2=0x7efde006a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:37.473 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.468+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007d040 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:37.650 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:37.645+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:59:38.069 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.064+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:38.069 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.064+0000 7efe0649d180 10 manifest: total_size = 18874368 2020-04-28T12:59:38.070 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.064+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.71 2020-04-28T12:59:38.070 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.064+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:38.070 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.064+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc14438 2020-04-28T12:59:38.070 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.065+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5.1201 2020-04-28T12:59:38.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:59:38.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:38.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:38.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:59:38.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:59:38.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:59:38.074 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:38.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.068+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:38.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:59:38.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:59:38.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:38.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:38.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:59:38.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2020-04-28T12:59:38.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.069+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.71 2020-04-28T12:59:38.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.070+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:38.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.070+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-simple.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:38.079 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.070+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:38.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.085+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007a1c0 msgr2=0x7efde006a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.107 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.102+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0075850 msgr2=0x7efde007b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.118 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.111+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.136 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.132+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde007d040 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.164 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.152+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0075850 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:38.180 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.174+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde006ad80 msgr2=0x7efde007b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.192 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.187+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:38.192 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.187+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:38.193 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.187+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:38.193 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.187+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:38.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.204+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0075850 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.218 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.213+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.280 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.275+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde007b490 msgr2=0x7efde0075820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.300 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.295+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:38.300 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.295+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:38.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2020-04-28T12:59:38.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:59:38.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:38.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:38.302 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:38.302 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2020-04-28T12:59:38.302 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2020-04-28T12:59:38.302 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.296+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912007 cookie 94693250876080 notifier 4728 bl.length()=183 2020-04-28T12:59:38.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.298+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5 from cache 2020-04-28T12:59:38.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.298+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=240 2020-04-28T12:59:38.303 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.298+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912008 cookie 94693250866560 notifier 4728 bl.length()=240 2020-04-28T12:59:38.403 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.398+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0072cd0 msgr2=0x7efde007a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.538 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.533+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0074cf0 msgr2=0x7efde007c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.673 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.668+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:38.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.668+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:59:38.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=227 2020-04-28T12:59:38.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2020-04-28T12:59:38.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:38.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:38.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.669+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 : miss 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 info.flags=0x16 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 to cache LRU end 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:38.677 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:38.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:38.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:38.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:38.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=320 2020-04-28T12:59:38.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 info.flags=0x13 2020-04-28T12:59:38.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 to cache LRU end 2020-04-28T12:59:38.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:38.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:38.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.670+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 2020-04-28T12:59:38.727 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.721+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.744+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.756+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:38.804 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.799+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7]) start_after [] num_entries 1100 2020-04-28T12:59:38.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.867+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:59:38.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.895+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:59:38.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:38.901+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:59:39.053 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.048+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.069 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.065+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:59:39.136 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.131+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:59:39.165 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.160+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.336 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.331+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:59:39.409 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.404+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.416 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.411+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:59:39.417 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.412+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0072cd0 msgr2=0x7efde007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.433 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.428+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:59:39.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.566+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:59:39.581 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.576+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:59:39.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.675+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:59:39.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.693+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:59:39.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.695+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.785 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.780+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074cf0 msgr2=0x7efde007c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:39.876 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.871+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.876 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.872+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.872+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.112 2020-04-28T12:59:39.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.872+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.872+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.872+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.126 2020-04-28T12:59:39.880 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:59:39.880 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:59:39.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.875+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.876+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.112 2020-04-28T12:59:39.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.877+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.877+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.878+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.114 2020-04-28T12:59:39.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.878+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.878+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.878+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.182 2020-04-28T12:59:39.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.880+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.880+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.888 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.881+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.114 2020-04-28T12:59:39.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.882+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.883+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.883+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _2obC2cb6mOSoZ4cG9axordWte1WC5J5 2020-04-28T12:59:39.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.883+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.883+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.883+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.192 2020-04-28T12:59:39.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.886+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _2obC2cb6mOSoZ4cG9axordWte1WC5J5 2020-04-28T12:59:39.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.108 2020-04-28T12:59:39.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.888+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.501 2020-04-28T12:59:39.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.891+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.891+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.892+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.108 2020-04-28T12:59:39.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.893+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.894+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.894+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _ZKgpv67ysshHRaMpQMljLb2ZyFqaZeN 2020-04-28T12:59:39.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.894+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.894+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.894+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.625 2020-04-28T12:59:39.902 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.902 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.897+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _ZKgpv67ysshHRaMpQMljLb2ZyFqaZeN 2020-04-28T12:59:39.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _NJkWtgaI1s5ncdTpG6gvI625Rpa_lpd 2020-04-28T12:59:39.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.899+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.965 2020-04-28T12:59:39.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.902+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.902+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.909 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.903+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _NJkWtgaI1s5ncdTpG6gvI625Rpa_lpd 2020-04-28T12:59:39.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.904+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.905+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.905+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _kPH8IHJoQRCeNXfBZquaEi88EP9qaI6 2020-04-28T12:59:39.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.905+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.905+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.905+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1116 2020-04-28T12:59:39.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.908+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.909+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _kPH8IHJoQRCeNXfBZquaEi88EP9qaI6 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.910+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.911+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.911+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.119 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.911+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.911+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.911+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1151 2020-04-28T12:59:39.918 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.913+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.919 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.913+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.919 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.914+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.119 2020-04-28T12:59:39.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _aw53tQZ8uP1h-pmJJkLoOnH4ABE5A1Y 2020-04-28T12:59:39.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.916+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1419 2020-04-28T12:59:39.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.919+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.919+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.926 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.926 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.926 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.926 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.927 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.927 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.927 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.927 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.927 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.920+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _aw53tQZ8uP1h-pmJJkLoOnH4ABE5A1Y 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.922+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.923+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.923+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.116 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.923+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.923+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.923+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1438 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.925+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.925+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.926+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.116 2020-04-28T12:59:39.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.927+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:39.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.928+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.928+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _LEr91Ez-gZ6IHh9yCc4HXS7gaZ-K8im 2020-04-28T12:59:39.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.928+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561f7dc14438 s->prefetch_data=0 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.928+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc14438 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.928+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1634 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.931+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.940 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.932+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _LEr91Ez-gZ6IHh9yCc4HXS7gaZ-K8im 2020-04-28T12:59:39.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.933+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.934+0000 7efe0649d180 10 manifest: total_size = 5242880 2020-04-28T12:59:39.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.934+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.109 2020-04-28T12:59:39.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.934+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:39.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.934+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:39.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.934+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7.1668 2020-04-28T12:59:39.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.936+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.936+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:39.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:39.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:59:39.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.937+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.109 2020-04-28T12:59:39.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.938+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:39.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.938+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:39.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.939+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:39.957 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.952+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:39.975 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:39.970+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde00750d0 msgr2=0x7efde0061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:40.017 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.012+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde0077dd0 msgr2=0x7efde0071e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:40.020 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.015+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0074cf0 msgr2=0x7efde007c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:40.232 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.226+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde005c7a0 msgr2=0x7efde006b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:40.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.234+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:40.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.234+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:40.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.234+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:40.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.234+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:40.344 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.339+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:40.344 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.339+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:40.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2020-04-28T12:59:40.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:59:40.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:40.345 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:40.346 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:40.346 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2020-04-28T12:59:40.346 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2020-04-28T12:59:40.346 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.340+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912005 cookie 94693250868592 notifier 4728 bl.length()=189 2020-04-28T12:59:40.347 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.342+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7 from cache 2020-04-28T12:59:40.347 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.342+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=246 2020-04-28T12:59:40.348 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.342+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912004 cookie 94693250881600 notifier 4728 bl.length()=246 2020-04-28T12:59:40.420 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.415+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0074cf0 msgr2=0x7efde00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:40.429 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.424+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde00750d0 msgr2=0x7efde0061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:40.716 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.711+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:40.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.711+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:40.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:40.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=237 2020-04-28T12:59:40.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2020-04-28T12:59:40.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:40.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:40.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.712+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 : miss 2020-04-28T12:59:40.720 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 info.flags=0x16 2020-04-28T12:59:40.720 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 to cache LRU end 2020-04-28T12:59:40.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:40.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:40.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:40.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:40.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:40.722 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:40.722 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.713+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:40.722 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=330 2020-04-28T12:59:40.722 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 info.flags=0x13 2020-04-28T12:59:40.722 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 to cache LRU end 2020-04-28T12:59:40.723 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:40.723 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:40.723 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.714+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 2020-04-28T12:59:40.817 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.812+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde006b5c0 msgr2=0x7efde007aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:40.845 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.840+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9]) start_after [] num_entries 1100 2020-04-28T12:59:40.910 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.905+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:59:40.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.928+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:40.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.933+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:59:40.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:40.939+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:59:41.017 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.012+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00750d0 msgr2=0x7efde006a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:41.102 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.097+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:59:41.168 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.161+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:59:41.335 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.330+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:59:41.410 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.405+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:59:41.427 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.422+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:59:41.569 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.564+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:59:41.579 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.574+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:59:41.626 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.621+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0072cd0 msgr2=0x7efde007a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:41.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.675+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:59:41.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.695+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:59:41.754 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.749+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde00750d0 msgr2=0x7efde006a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:41.781 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.776+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:41.871 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.865+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561f7dcacc38 s->prefetch_data=0 2020-04-28T12:59:41.871 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.866+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.866+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.234 2020-04-28T12:59:41.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.866+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561f7dcacc38 s->prefetch_data=0 2020-04-28T12:59:41.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.866+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dcacc38 2020-04-28T12:59:41.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.866+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.126 2020-04-28T12:59:41.874 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:59:41.874 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.875 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.875 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.875 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.876 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:59:41.876 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.869+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.876 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.877 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.878 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:41.878 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.878 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.878 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.878 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.879 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:41.879 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.879 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:41.879 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.870+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.234 2020-04-28T12:59:41.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.871+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.872+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.872+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.236 2020-04-28T12:59:41.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.872+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.872+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.872+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.182 2020-04-28T12:59:41.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.874+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.874+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.884 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:41.885 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.886 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:41.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.875+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.236 2020-04-28T12:59:41.887 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.876+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.877+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.877+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _1DbutjylAwhA5I0FN0bjpoi1XSBeKQn 2020-04-28T12:59:41.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.877+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.889 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.877+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.877+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.192 2020-04-28T12:59:41.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.890 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.891 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.892 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.880+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _1DbutjylAwhA5I0FN0bjpoi1XSBeKQn 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.893 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.225 2020-04-28T12:59:41.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.894 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.882+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.501 2020-04-28T12:59:41.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.885+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.896 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.885+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.896 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.896 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.896 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.896 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:41.899 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.886+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.225 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 10 manifest: total_size = 45360 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _dpvqxpRmYxefhm_xMERNyjDQOEn1i7w 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.888+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.625 2020-04-28T12:59:41.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.891+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.891+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.891+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.891+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.891+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.892+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _dpvqxpRmYxefhm_xMERNyjDQOEn1i7w 2020-04-28T12:59:41.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.893+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.894+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.894+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _AgNgNzZ4b2EoZJWRyLLay8LEpdrJjVJ 2020-04-28T12:59:41.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.894+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.894+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:41.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.894+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.965 2020-04-28T12:59:41.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.897+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.908 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde006ad80 msgr2=0x7efde007ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:41.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.911 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.898+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.912 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.899+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _AgNgNzZ4b2EoZJWRyLLay8LEpdrJjVJ 2020-04-28T12:59:41.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.900+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.900+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.900+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _oqaeR__Al_yFTgmc4qC8xIte7JL4hj5 2020-04-28T12:59:41.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.900+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.900+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:41.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.901+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1116 2020-04-28T12:59:41.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.903+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.903+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.904+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _oqaeR__Al_yFTgmc4qC8xIte7JL4hj5 2020-04-28T12:59:41.917 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561f7dc15518 s->prefetch_data=0 2020-04-28T12:59:41.919 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 10 manifest: total_size = 45360 2020-04-28T12:59:41.919 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.246 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561f7dc15518 s->prefetch_data=0 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc15518 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.906+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1151 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.920 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.909+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.921 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.922 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2020-04-28T12:59:41.923 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.910+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.246 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.911+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561f7dc15518 s->prefetch_data=0 2020-04-28T12:59:41.924 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.912+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.912+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _Lxq1lMAADh_IQNsbC9t_K5ehuueBaOF 2020-04-28T12:59:41.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.912+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561f7dc15518 s->prefetch_data=0 2020-04-28T12:59:41.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.912+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc15518 2020-04-28T12:59:41.925 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.912+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1419 2020-04-28T12:59:41.928 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.929 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.929 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.929 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.929 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.929 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.930 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.930 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.930 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.930 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.930 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.915+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.931 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.916+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.916+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _Lxq1lMAADh_IQNsbC9t_K5ehuueBaOF 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 10 manifest: total_size = 45360 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.243 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:41.932 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:41.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.917+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1438 2020-04-28T12:59:41.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.920+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.920+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.933 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.935 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2020-04-28T12:59:41.936 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.921+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.243 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.922+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.937 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.923+0000 7efe0649d180 10 manifest: total_size = 45360 2020-04-28T12:59:41.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.923+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to _uVCh1kmLU0LeqUnrm5TH1a78WHPoIBU 2020-04-28T12:59:41.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.923+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.923+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.938 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.923+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1634 2020-04-28T12:59:41.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.925+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.925+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.941 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.942 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:41.943 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.926+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _uVCh1kmLU0LeqUnrm5TH1a78WHPoIBU 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.927+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.928+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.928+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.226 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.928+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561f7db26de8 s->prefetch_data=0 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.928+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7db26de8 2020-04-28T12:59:41.944 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.928+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9.1668 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.930+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.930+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.945 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:41.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:41.947 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.931+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.226 2020-04-28T12:59:41.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.933+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:41.949 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.933+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:41.949 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:41.933+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:42.017 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.012+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b5c0 msgr2=0x7efde007aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.051 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.046+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:42.052 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.046+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:42.052 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.046+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:42.052 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.046+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:42.081 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.076+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde005ec20 msgr2=0x7efde00727f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.105 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.100+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde00750d0 msgr2=0x7efde0061100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.132 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.127+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0077dd0 msgr2=0x7efde0071dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.137+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde007a5a0 msgr2=0x7efde0070560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.164 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:42.164 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:42.165 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2020-04-28T12:59:42.165 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:59:42.165 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:42.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:42.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:42.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2020-04-28T12:59:42.167 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.158+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2020-04-28T12:59:42.167 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.159+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912002 cookie 94693250870432 notifier 4728 bl.length()=199 2020-04-28T12:59:42.168 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.161+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9 from cache 2020-04-28T12:59:42.168 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.161+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=256 2020-04-28T12:59:42.168 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.161+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912001 cookie 94693249416128 notifier 4728 bl.length()=256 2020-04-28T12:59:42.290 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.285+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde006b5c0 msgr2=0x7efde007aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.339 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.334+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde00750d0 msgr2=0x7efde007d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.403 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.398+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde006ad80 msgr2=0x7efde007ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.575 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.570+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:42.576 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.570+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:59:42.626 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2020-04-28T12:59:42.626 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=232 2020-04-28T12:59:42.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.571+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 : miss 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 info.flags=0x16 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 to cache LRU end 2020-04-28T12:59:42.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:42.629 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:42.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=325 2020-04-28T12:59:42.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 info.flags=0x13 2020-04-28T12:59:42.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 to cache LRU end 2020-04-28T12:59:42.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:42.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:42.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.572+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 2020-04-28T12:59:42.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.600+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0074cf0 msgr2=0x7efde006a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.631 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.625+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde005ec20 msgr2=0x7efde0071dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.660 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.654+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0074cf0 msgr2=0x7efde007c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:42.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.680+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.680+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.692 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.687+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007a5a0 msgr2=0x7efde007ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:42.716 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.711+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8]) start_after [] num_entries 1100 2020-04-28T12:59:42.777 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.772+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:59:42.962 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:42.957+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:59:43.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.141+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde0074cf0 msgr2=0x7efde007c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.322 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.317+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00727f0 msgr2=0x7efde006a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:43.443 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.438+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:59:43.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:43.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.204 2020-04-28T12:59:43.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:43.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.724+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8.126 2020-04-28T12:59:43.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:59:43.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:59:43.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.727+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:43.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:43.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:43.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.728+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.204 2020-04-28T12:59:43.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.729+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.730+0000 7efe0649d180 10 manifest: total_size = 11534336 2020-04-28T12:59:43.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.730+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.197 2020-04-28T12:59:43.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.730+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.730+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:43.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.730+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8.501 2020-04-28T12:59:43.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:43.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:43.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.742 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:43.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:43.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:43.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:43.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:59:43.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:43.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:59:43.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:59:43.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:59:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:59:43.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:59:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.733+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.197 2020-04-28T12:59:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.735+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.736+0000 7efe0649d180 10 manifest: total_size = 16377 2020-04-28T12:59:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.736+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.211 2020-04-28T12:59:43.746 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.736+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:43.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.736+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:43.747 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.736+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8.1438 2020-04-28T12:59:43.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.738+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.738+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:59:43.750 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:43.751 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7671 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2020-04-28T12:59:43.752 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.739+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.211 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.741+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.741+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:43.753 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.741+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:43.781 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.775+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde0074cf0 msgr2=0x7efde007c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.798 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.793+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.813 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.808+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.814 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.808+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.862 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.857+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:43.862 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.857+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:43.862 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.857+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:43.863 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.857+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:43.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.963+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde00727f0 msgr2=0x7efde006a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.976 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.971+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde007b490 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:43.980 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.975+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:43.980 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.975+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:43.981 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2020-04-28T12:59:43.981 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:59:43.982 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:43.982 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:43.982 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:43.982 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2020-04-28T12:59:43.983 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2020-04-28T12:59:43.983 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.976+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912005 cookie 94693250878576 notifier 4728 bl.length()=194 2020-04-28T12:59:43.983 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.978+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8 from cache 2020-04-28T12:59:43.984 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.978+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=251 2020-04-28T12:59:43.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:43.979+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912002 cookie 94693249416128 notifier 4728 bl.length()=251 2020-04-28T12:59:44.363 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.358+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:44.364 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.358+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:59:44.366 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2020-04-28T12:59:44.366 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:44.367 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:44.367 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:44.367 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:44.367 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:44.368 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=222 2020-04-28T12:59:44.368 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2020-04-28T12:59:44.368 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:44.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:44.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.359+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 : miss 2020-04-28T12:59:44.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 info.flags=0x16 2020-04-28T12:59:44.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 to cache LRU end 2020-04-28T12:59:44.370 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:44.370 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:44.370 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:44.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:44.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:44.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:44.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:44.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=315 2020-04-28T12:59:44.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 info.flags=0x13 2020-04-28T12:59:44.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 to cache LRU end 2020-04-28T12:59:44.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:44.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:44.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.360+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 2020-04-28T12:59:44.446 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.441+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde007a5a0 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:44.483 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.478+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6]) start_after [] num_entries 1100 2020-04-28T12:59:44.547 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.541+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:59:44.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.689+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074cf0 msgr2=0x7efde007c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:44.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.730+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:59:44.830 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.825+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007a1c0 msgr2=0x7efde005e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:44.999 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:44.994+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde007a5a0 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.174 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.169+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.198 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.193+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde005ec20 msgr2=0x7efde0061bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.218 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.213+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:59:45.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.718+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.720+0000 7efe0649d180 10 manifest: total_size = 10485760 2020-04-28T12:59:45.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.720+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.85 2020-04-28T12:59:45.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.720+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.720+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:45.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.720+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6.126 2020-04-28T12:59:45.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:59:45.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.723+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:59:45.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.724+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.85 2020-04-28T12:59:45.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.725+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.726+0000 7efe0649d180 10 manifest: total_size = 10485760 2020-04-28T12:59:45.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.726+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.84 2020-04-28T12:59:45.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.726+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.726+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:45.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.726+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6.501 2020-04-28T12:59:45.734 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:45.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:45.736 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:45.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:45.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:59:45.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:45.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:59:45.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.729+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.84 2020-04-28T12:59:45.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 10 manifest: total_size = 10485760 2020-04-28T12:59:45.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.86 2020-04-28T12:59:45.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:45.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:45.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.731+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6.1438 2020-04-28T12:59:45.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.734+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:45.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.734+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:45.744 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:59:45.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:45.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:45.745 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.735+0000 7efe0649d180 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.86 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.737+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.737+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:45.749 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.737+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:45.761 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.757+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.840 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.835+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde00727f0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.859 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.855+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:45.860 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.855+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:45.860 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.855+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:45.861 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.855+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:45.872 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.867+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde008bc50 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.934 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.929+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde00750d0 msgr2=0x7efde00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.939 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.934+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074cf0 msgr2=0x7efde0062050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.946 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.941+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074cf0 msgr2=0x7efde0062050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:45.948 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.943+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde00727f0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:45.955 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:45.950+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde007a5a0 msgr2=0x7efde007dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:46.156 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.151+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:46.156 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.151+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:46.157 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.151+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2020-04-28T12:59:46.157 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.151+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:59:46.158 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.151+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:46.158 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.152+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:46.158 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.152+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:46.158 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.152+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2020-04-28T12:59:46.158 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.152+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2020-04-28T12:59:46.159 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.152+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912006 cookie 94693250868592 notifier 4728 bl.length()=184 2020-04-28T12:59:46.159 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.154+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6 from cache 2020-04-28T12:59:46.159 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.154+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=241 2020-04-28T12:59:46.160 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.155+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912006 cookie 94693250878576 notifier 4728 bl.length()=241 2020-04-28T12:59:46.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.523+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:46.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.523+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:46.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.524+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 : miss 2020-04-28T12:59:46.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 info.flags=0x16 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 to cache LRU end 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:46.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.525+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 info.flags=0x13 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 to cache LRU end 2020-04-28T12:59:46.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:46.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:46.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.526+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 2020-04-28T12:59:46.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.583+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde007d460 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:46.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.622+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde005ec20 msgr2=0x7efde0061bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:46.648 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.643+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10]) start_after [] num_entries 1100 2020-04-28T12:59:46.711 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.702+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:59:46.829 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:46.824+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:59:47.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.008+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:59:47.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.265+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde008bc50 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.464 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.459+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:59:47.689 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.689 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 10 manifest: total_size = 0 2020-04-28T12:59:47.690 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.306 2020-04-28T12:59:47.690 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.690 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc41e98 2020-04-28T12:59:47.690 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.684+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10.111 2020-04-28T12:59:47.692 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:59:47.692 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.687+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:47.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:47.695 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:47.695 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.695 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 10 manifest: total_size = 0 2020-04-28T12:59:47.696 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.305 2020-04-28T12:59:47.696 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.696 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc41e98 2020-04-28T12:59:47.696 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.688+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10.349 2020-04-28T12:59:47.697 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.697 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.691+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.699 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 10 manifest: total_size = 0 2020-04-28T12:59:47.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.307 2020-04-28T12:59:47.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc41e98 2020-04-28T12:59:47.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.692+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10.695 2020-04-28T12:59:47.701 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.701 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.695+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 10 manifest: total_size = 0 2020-04-28T12:59:47.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.308 2020-04-28T12:59:47.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561f7dc41e98 s->prefetch_data=0 2020-04-28T12:59:47.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.696+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc41e98 2020-04-28T12:59:47.704 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.697+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10.1557 2020-04-28T12:59:47.705 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.699+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.705 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.699+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.706 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.706 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.706 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.706 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:47.707 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:47.707 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:47.707 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:59:47.707 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.708 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:47.708 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:47.708 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:47.708 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:47.709 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.700+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:47.709 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.701+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:47.727 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.722+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.768 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.763+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007a5a0 msgr2=0x7efde007dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.790 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.785+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde005ec20 msgr2=0x7efde007c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.806 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.800+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde0074cf0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.817 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.812+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:47.818 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.812+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:47.818 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.813+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:47.818 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.813+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:47.895 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.890+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde0074cf0 msgr2=0x7efde0068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.953 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.948+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:47.983 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.978+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:47.983 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.978+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:47.984 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2020-04-28T12:59:47.985 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:59:47.986 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.979+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912009 cookie 94693250866560 notifier 4728 bl.length()=181 2020-04-28T12:59:47.986 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.981+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.10 from cache 2020-04-28T12:59:47.986 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.981+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2020-04-28T12:59:47.987 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:47.981+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912003 cookie 94693250870432 notifier 4728 bl.length()=239 2020-04-28T12:59:48.156 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.151+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00727f0 msgr2=0x7efde0063860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:48.335 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.330+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:48.368 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:48.369 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:48.370 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.363+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:48.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:59:48.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2020-04-28T12:59:48.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:48.371 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 : miss 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 info.flags=0x16 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 to cache LRU end 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:48.372 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:48.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:48.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:48.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:48.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.364+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:48.373 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:59:48.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 info.flags=0x13 2020-04-28T12:59:48.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 to cache LRU end 2020-04-28T12:59:48.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:48.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:48.374 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.365+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 2020-04-28T12:59:48.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.432+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde007a5a0 msgr2=0x7efde00750d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:48.444 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.439+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde0074cf0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:48.483 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.478+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:48.492 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.487+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11]) start_after [] num_entries 1100 2020-04-28T12:59:48.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.545+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:59:48.671 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.666+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:59:48.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.755+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde007bb00 msgr2=0x7efde00688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:48.845 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:48.840+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:59:49.316 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.310+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:59:49.543 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 10 manifest: total_size = 2078 2020-04-28T12:59:49.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.313 2020-04-28T12:59:49.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:49.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.538+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11.111 2020-04-28T12:59:49.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.541+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:59:49.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.541+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.547 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:49.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:49.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:49.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.542+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.543+0000 7efe0649d180 10 manifest: total_size = 24595 2020-04-28T12:59:49.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.543+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.312 2020-04-28T12:59:49.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.543+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.543+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:49.551 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.543+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11.349 2020-04-28T12:59:49.552 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.552 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.552 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.553 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.554 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:49.554 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:49.554 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:49.554 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.546+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.555 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.547+0000 7efe0649d180 10 manifest: total_size = 524288 2020-04-28T12:59:49.555 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.547+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.314 2020-04-28T12:59:49.555 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.547+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.556 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.547+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:49.556 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.547+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11.695 2020-04-28T12:59:49.557 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.549+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.557 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.549+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.558 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:49.559 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.550+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.560 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.551+0000 7efe0649d180 10 manifest: total_size = 527 2020-04-28T12:59:49.560 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.551+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.315 2020-04-28T12:59:49.560 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.551+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561f7dc21728 s->prefetch_data=0 2020-04-28T12:59:49.560 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.551+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dc21728 2020-04-28T12:59:49.561 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.551+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11.1557 2020-04-28T12:59:49.563 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.563 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.563 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.564 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.564 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.564 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:49.564 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.554+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:49.565 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:49.565 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:59:49.565 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.565 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:49.565 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:49.566 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:49.566 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:49.566 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.2[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:49.567 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.555+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:49.567 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.556+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde00727f0 msgr2=0x7efde0063820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.567 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.561+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde007a5a0 msgr2=0x7efde0073960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.567+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde005ec20 msgr2=0x7efde007bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:49.600 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.595+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde0074cf0 msgr2=0x7efde00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.608 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.603+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde008bc50 msgr2=0x7efde0075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:49.621 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.616+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.660 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.653+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7efde007a1c0 msgr2=0x7efde005e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:49.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.673+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:49.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.673+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:49.679 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.673+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:49.679 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.673+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:49.688 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.683+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.711 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.706+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00727f0 msgr2=0x7efde0063820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.723+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00727f0 msgr2=0x7efde0063110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.759 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.753+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde008bc50 msgr2=0x7efde0077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.770 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.765+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:49.967 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:49.967 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:49.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2020-04-28T12:59:49.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:59:49.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:49.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:49.968 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:49.969 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2020-04-28T12:59:49.969 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.962+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:59:49.970 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.963+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912010 cookie 94693250866560 notifier 4728 bl.length()=181 2020-04-28T12:59:49.970 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.965+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.11 from cache 2020-04-28T12:59:49.971 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.966+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2020-04-28T12:59:49.971 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:49.966+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912004 cookie 94693250870432 notifier 4728 bl.length()=239 2020-04-28T12:59:50.023 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.018+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde007bb00 msgr2=0x7efde00688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:50.083 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.078+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:50.097 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.092+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde007bb00 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:50.348 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.342+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x561f7d7c93c0 s->prefetch_data=0 2020-04-28T12:59:50.348 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.342+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:59:50.348 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2020-04-28T12:59:50.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:50.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:50.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:50.349 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:59:50.350 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:50.350 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:59:50.350 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2020-04-28T12:59:50.351 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:50.351 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f70a30 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:50.351 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.343+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 : miss 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 info.flags=0x16 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 to cache LRU end 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:50.353 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 20 Read xattr: user.rgw.acl 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 20 Read xattr: user.rgw.idtag 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.344+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 info.flags=0x13 2020-04-28T12:59:50.354 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 to cache LRU end 2020-04-28T12:59:50.355 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:50.355 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:59:50.355 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.345+0000 7efe0649d180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 2020-04-28T12:59:50.384 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.379+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde006ad80 msgr2=0x7efde007ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:50.482 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.473+0000 7efe0649d180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12]) start_after [] num_entries 1100 2020-04-28T12:59:50.538 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.533+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:59:50.663 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.658+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:59:50.844 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:50.839+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:59:51.164 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.159+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6808/23339,v1:172.21.15.84:6809/23339] conn(0x7efde007a5a0 msgr2=0x7efde0062cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.262 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.257+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde007bb00 msgr2=0x7efde007b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:51.289 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.284+0000 7efe0649d180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:59:51.515 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.510+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.516 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.511+0000 7efe0649d180 10 manifest: total_size = 1048576 2020-04-28T12:59:51.516 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.511+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.320 2020-04-28T12:59:51.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.511+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.511+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:51.517 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.511+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12.111 2020-04-28T12:59:51.519 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.514+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:59:51.519 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.514+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:59:51.520 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.515+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.516+0000 7efe0649d180 10 manifest: total_size = 1048576 2020-04-28T12:59:51.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.516+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.319 2020-04-28T12:59:51.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.516+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.516+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:51.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.516+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12.349 2020-04-28T12:59:51.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.518+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.518+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.525 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:51.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:51.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:51.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.519+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.527 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.520+0000 7efe0649d180 10 manifest: total_size = 110 2020-04-28T12:59:51.527 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.520+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.321 2020-04-28T12:59:51.527 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.520+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.527 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.520+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:51.527 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.520+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12.695 2020-04-28T12:59:51.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.530 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:51.531 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.524+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.525+0000 7efe0649d180 10 manifest: total_size = 4134 2020-04-28T12:59:51.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.525+0000 7efe0649d180 20 get_obj_state: setting s->obj_tag to 5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.322 2020-04-28T12:59:51.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.525+0000 7efe0649d180 20 get_obj_state: rctx=0x7ffe93f709d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561f7dbf0758 s->prefetch_data=0 2020-04-28T12:59:51.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.525+0000 7efe0649d180 20 prepare_atomic_modification: state is not atomic. state=0x561f7dbf0758 2020-04-28T12:59:51.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.525+0000 7efe0649d180 20 bucket index object: default.rgw.buckets.index:.dir.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12.1557 2020-04-28T12:59:51.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.526+0000 7efdc4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:59:51.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.528+0000 7efe0649d180 20 rados->read ofs=0 len=0 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 10 chain_cache_entry: cache_locator= 2020-04-28T12:59:51.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:59:51.536 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:59:51.536 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:59:51.536 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.3[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:59:51.536 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.529+0000 7efe0649d180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:59:51.569 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.564+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efde006b5c0 msgr2=0x7efde007a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.574 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.569+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6824/23557,v1:172.21.15.84:6825/23557] conn(0x7efde006ad80 msgr2=0x7efde007eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.644+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:59:51.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.644+0000 7efe0649d180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:59:51.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.644+0000 7efe0649d180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:59:51.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.644+0000 7efe0649d180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12])"; objs.size()=0; is_truncated=0 2020-04-28T12:59:51.660 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.656+0000 7efdf4c87700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6818/23465,v1:172.21.15.176:6819/23465] conn(0x7efde007a1c0 msgr2=0x7efde005e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.686 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.681+0000 7efdf4486700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6800/23178,v1:172.21.15.84:6801/23178] conn(0x7efde00727f0 msgr2=0x7efde0063110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.734+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.176:6810/23439,v1:172.21.15.176:6811/23439] conn(0x7efde006ad80 msgr2=0x7efde0074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:51.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 20 get_system_obj_state: rctx=0x7ffe93f701c8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x561f7d805170 s->prefetch_data=0 2020-04-28T12:59:51.762 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:59:51.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2020-04-28T12:59:51.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:59:51.763 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:59:51.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:59:51.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2020-04-28T12:59:51.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2020-04-28T12:59:51.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.757+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:59:51.764 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.758+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912011 cookie 94693250866560 notifier 4728 bl.length()=181 2020-04-28T12:59:51.765 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.760+0000 7efe0649d180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.12 from cache 2020-04-28T12:59:51.765 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.760+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2020-04-28T12:59:51.765 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.760+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912005 cookie 94693250870432 notifier 4728 bl.length()=239 2020-04-28T12:59:51.771 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:51.764+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde00708e0 msgr2=0x7efde0077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:59:52.006 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.000+0000 7efdf3c85700 0 -- 172.21.15.176:0/436728892 >> [v2:172.21.15.84:6816/23358,v1:172.21.15.84:6817/23358] conn(0x7efde006ad80 msgr2=0x7efde0074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:59:52.136 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.131+0000 7efe0649d180 10 removing key index: SSAACGTVGBSTDWALHHOJ 2020-04-28T12:59:52.136 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.131+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2020-04-28T12:59:52.136 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.131+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912012 cookie 94693250876080 notifier 4728 bl.length()=170 2020-04-28T12:59:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.133+0000 7efe0649d180 10 removing email index: ragweed.client.0+test@test.test 2020-04-28T12:59:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.133+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2020-04-28T12:59:52.138 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.133+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912007 cookie 94693250868592 notifier 4728 bl.length()=182 2020-04-28T12:59:52.140 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.135+0000 7efe0649d180 10 removing user buckets index 2020-04-28T12:59:52.140 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.135+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2020-04-28T12:59:52.140 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.135+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912007 cookie 94693250878576 notifier 4728 bl.length()=173 2020-04-28T12:59:52.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.137+0000 7efe0649d180 10 removing user index: ragweed.client.0 2020-04-28T12:59:52.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.137+0000 7efe0649d180 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2020-04-28T12:59:52.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.137+0000 7efe0649d180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2020-04-28T12:59:52.142 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.137+0000 7efdd9ffb700 10 RGWWatcher::handle_notify() notify_id 536870912013 cookie 94693250876080 notifier 4728 bl.length()=165 2020-04-28T12:59:52.144 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.139+0000 7efdc4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:59:52.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.140+0000 7efe0649d180 20 remove_watcher() i=0 2020-04-28T12:59:52.145 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.140+0000 7efe0649d180 2 removed watcher, disabling cache 2020-04-28T12:59:52.146 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.141+0000 7efe0649d180 20 remove_watcher() i=1 2020-04-28T12:59:52.148 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.143+0000 7efe0649d180 20 remove_watcher() i=2 2020-04-28T12:59:52.149 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.144+0000 7efe0649d180 20 remove_watcher() i=3 2020-04-28T12:59:52.150 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.145+0000 7efe0649d180 20 remove_watcher() i=4 2020-04-28T12:59:52.151 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.146+0000 7efe0649d180 20 remove_watcher() i=5 2020-04-28T12:59:52.153 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.148+0000 7efe0649d180 20 remove_watcher() i=6 2020-04-28T12:59:52.154 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T12:59:52.149+0000 7efe0649d180 20 remove_watcher() i=7 2020-04-28T12:59:52.158 INFO:tasks.ragweed:Removing ragweed... 2020-04-28T12:59:52.159 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:52.212 INFO:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/ragweed 2020-04-28T12:59:52.303 INFO:teuthology.run_tasks:Running task s3tests-java... 2020-04-28T12:59:52.322 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2020-04-28T12:59:52.323 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2020-04-28T12:59:52.325 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2020-04-28T12:59:52.325 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:52.338 INFO:teuthology.orchestra.run.smithi176:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2020-04-28T12:59:52.395 INFO:teuthology.orchestra.run.smithi176.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2020-04-28T12:59:56.816 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2020-04-28T12:59:56.816 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T12:59:56.872 INFO:teuthology.orchestra.run.smithi176:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2020-04-28T12:59:58.231 INFO:teuthology.orchestra.run.smithi176.stdout: Gradle will be installed under /opt/gradle 2020-04-28T12:59:58.804 INFO:teuthology.orchestra.run.smithi176.stderr:--2020-04-28 12:59:58-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:59:59.751 INFO:teuthology.orchestra.run.smithi176.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.190.9, 104.18.191.9, 2606:4700::6812:be09, ... 2020-04-28T12:59:59.769 INFO:teuthology.orchestra.run.smithi176.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.190.9|:443... connected. 2020-04-28T12:59:59.938 INFO:teuthology.orchestra.run.smithi176.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2020-04-28T12:59:59.939 INFO:teuthology.orchestra.run.smithi176.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip [following] 2020-04-28T12:59:59.939 INFO:teuthology.orchestra.run.smithi176.stderr:--2020-04-28 12:59:59-- https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:59:59.939 INFO:teuthology.orchestra.run.smithi176.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.159.20, 104.17.160.20, 2606:4700::6811:a014, ... 2020-04-28T12:59:59.958 INFO:teuthology.orchestra.run.smithi176.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.159.20|:443... connected. 2020-04-28T13:00:00.033 INFO:teuthology.orchestra.run.smithi176.stderr:HTTP request sent, awaiting response... 200 OK 2020-04-28T13:00:00.125 INFO:teuthology.orchestra.run.smithi176.stderr:Length: 95129672 (91M) [application/zip] 2020-04-28T13:00:00.125 INFO:teuthology.orchestra.run.smithi176.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2020-04-28T13:00:00.125 INFO:teuthology.orchestra.run.smithi176.stderr: 2020-04-28T13:00:00.125 INFO:teuthology.orchestra.run.smithi176.stderr: 0K .......... .......... .......... .......... .......... 0% 61.8M 1s 2020-04-28T13:00:00.126 INFO:teuthology.orchestra.run.smithi176.stderr: 50K .......... .......... .......... .......... .......... 0% 96.2M 1s 2020-04-28T13:00:00.127 INFO:teuthology.orchestra.run.smithi176.stderr: 100K .......... .......... .......... .......... .......... 0% 105M 1s 2020-04-28T13:00:00.127 INFO:teuthology.orchestra.run.smithi176.stderr: 150K .......... .......... .......... .......... .......... 0% 115M 1s 2020-04-28T13:00:00.139 INFO:teuthology.orchestra.run.smithi176.stderr: 200K .......... .......... .......... .......... .......... 0% 2.89M 7s 2020-04-28T13:00:00.140 INFO:teuthology.orchestra.run.smithi176.stderr: 250K .......... .......... .......... .......... .......... 0% 55.8M 6s 2020-04-28T13:00:00.141 INFO:teuthology.orchestra.run.smithi176.stderr: 300K .......... .......... .......... .......... .......... 0% 62.0M 5s 2020-04-28T13:00:00.157 INFO:teuthology.orchestra.run.smithi176.stderr: 350K .......... .......... .......... .......... .......... 0% 2.95M 9s 2020-04-28T13:00:00.159 INFO:teuthology.orchestra.run.smithi176.stderr: 400K .......... .......... .......... .......... .......... 0% 25.4M 8s 2020-04-28T13:00:00.168 INFO:teuthology.orchestra.run.smithi176.stderr: 450K .......... .......... .......... .......... .......... 0% 5.69M 9s 2020-04-28T13:00:00.177 INFO:teuthology.orchestra.run.smithi176.stderr: 500K .......... .......... .......... .......... .......... 0% 6.51M 9s 2020-04-28T13:00:00.182 INFO:teuthology.orchestra.run.smithi176.stderr: 550K .......... .......... .......... .......... .......... 0% 7.09M 10s 2020-04-28T13:00:00.187 INFO:teuthology.orchestra.run.smithi176.stderr: 600K .......... .......... .......... .......... .......... 0% 11.3M 9s 2020-04-28T13:00:00.192 INFO:teuthology.orchestra.run.smithi176.stderr: 650K .......... .......... .......... .......... .......... 0% 9.41M 9s 2020-04-28T13:00:00.196 INFO:teuthology.orchestra.run.smithi176.stderr: 700K .......... .......... .......... .......... .......... 0% 11.3M 9s 2020-04-28T13:00:00.200 INFO:teuthology.orchestra.run.smithi176.stderr: 750K .......... .......... .......... .......... .......... 0% 11.8M 9s 2020-04-28T13:00:00.205 INFO:teuthology.orchestra.run.smithi176.stderr: 800K .......... .......... .......... .......... .......... 0% 9.40M 9s 2020-04-28T13:00:00.209 INFO:teuthology.orchestra.run.smithi176.stderr: 850K .......... .......... .......... .......... .......... 0% 11.9M 9s 2020-04-28T13:00:00.215 INFO:teuthology.orchestra.run.smithi176.stderr: 900K .......... .......... .......... .......... .......... 1% 9.63M 9s 2020-04-28T13:00:00.219 INFO:teuthology.orchestra.run.smithi176.stderr: 950K .......... .......... .......... .......... .......... 1% 9.91M 9s 2020-04-28T13:00:00.223 INFO:teuthology.orchestra.run.smithi176.stderr: 1000K .......... .......... .......... .......... .......... 1% 13.1M 9s 2020-04-28T13:00:00.226 INFO:teuthology.orchestra.run.smithi176.stderr: 1050K .......... .......... .......... .......... .......... 1% 16.0M 9s 2020-04-28T13:00:00.231 INFO:teuthology.orchestra.run.smithi176.stderr: 1100K .......... .......... .......... .......... .......... 1% 12.0M 9s 2020-04-28T13:00:00.234 INFO:teuthology.orchestra.run.smithi176.stderr: 1150K .......... .......... .......... .......... .......... 1% 11.8M 9s 2020-04-28T13:00:00.238 INFO:teuthology.orchestra.run.smithi176.stderr: 1200K .......... .......... .......... .......... .......... 1% 14.4M 9s 2020-04-28T13:00:00.241 INFO:teuthology.orchestra.run.smithi176.stderr: 1250K .......... .......... .......... .......... .......... 1% 16.1M 9s 2020-04-28T13:00:00.246 INFO:teuthology.orchestra.run.smithi176.stderr: 1300K .......... .......... .......... .......... .......... 1% 12.9M 8s 2020-04-28T13:00:00.248 INFO:teuthology.orchestra.run.smithi176.stderr: 1350K .......... .......... .......... .......... .......... 1% 14.0M 8s 2020-04-28T13:00:00.251 INFO:teuthology.orchestra.run.smithi176.stderr: 1400K .......... .......... .......... .......... .......... 1% 14.2M 8s 2020-04-28T13:00:00.255 INFO:teuthology.orchestra.run.smithi176.stderr: 1450K .......... .......... .......... .......... .......... 1% 14.6M 8s 2020-04-28T13:00:00.258 INFO:teuthology.orchestra.run.smithi176.stderr: 1500K .......... .......... .......... .......... .......... 1% 15.1M 8s 2020-04-28T13:00:00.260 INFO:teuthology.orchestra.run.smithi176.stderr: 1550K .......... .......... .......... .......... .......... 1% 23.1M 8s 2020-04-28T13:00:00.263 INFO:teuthology.orchestra.run.smithi176.stderr: 1600K .......... .......... .......... .......... .......... 1% 15.3M 8s 2020-04-28T13:00:00.267 INFO:teuthology.orchestra.run.smithi176.stderr: 1650K .......... .......... .......... .......... .......... 1% 15.1M 8s 2020-04-28T13:00:00.271 INFO:teuthology.orchestra.run.smithi176.stderr: 1700K .......... .......... .......... .......... .......... 1% 23.9M 8s 2020-04-28T13:00:00.272 INFO:teuthology.orchestra.run.smithi176.stderr: 1750K .......... .......... .......... .......... .......... 1% 12.7M 8s 2020-04-28T13:00:00.275 INFO:teuthology.orchestra.run.smithi176.stderr: 1800K .......... .......... .......... .......... .......... 1% 23.1M 8s 2020-04-28T13:00:00.278 INFO:teuthology.orchestra.run.smithi176.stderr: 1850K .......... .......... .......... .......... .......... 2% 17.5M 8s 2020-04-28T13:00:00.288 INFO:teuthology.orchestra.run.smithi176.stderr: 1900K .......... .......... .......... .......... .......... 2% 17.3M 7s 2020-04-28T13:00:00.288 INFO:teuthology.orchestra.run.smithi176.stderr: 1950K .......... .......... .......... .......... .......... 2% 17.6M 7s 2020-04-28T13:00:00.288 INFO:teuthology.orchestra.run.smithi176.stderr: 2000K .......... .......... .......... .......... .......... 2% 26.9M 7s 2020-04-28T13:00:00.288 INFO:teuthology.orchestra.run.smithi176.stderr: 2050K .......... .......... .......... .......... .......... 2% 19.4M 7s 2020-04-28T13:00:00.291 INFO:teuthology.orchestra.run.smithi176.stderr: 2100K .......... .......... .......... .......... .......... 2% 17.3M 7s 2020-04-28T13:00:00.293 INFO:teuthology.orchestra.run.smithi176.stderr: 2150K .......... .......... .......... .......... .......... 2% 20.0M 7s 2020-04-28T13:00:00.295 INFO:teuthology.orchestra.run.smithi176.stderr: 2200K .......... .......... .......... .......... .......... 2% 19.9M 7s 2020-04-28T13:00:00.298 INFO:teuthology.orchestra.run.smithi176.stderr: 2250K .......... .......... .......... .......... .......... 2% 20.1M 7s 2020-04-28T13:00:00.299 INFO:teuthology.orchestra.run.smithi176.stderr: 2300K .......... .......... .......... .......... .......... 2% 28.9M 7s 2020-04-28T13:00:00.302 INFO:teuthology.orchestra.run.smithi176.stderr: 2350K .......... .......... .......... .......... .......... 2% 20.2M 7s 2020-04-28T13:00:00.304 INFO:teuthology.orchestra.run.smithi176.stderr: 2400K .......... .......... .......... .......... .......... 2% 21.4M 7s 2020-04-28T13:00:00.306 INFO:teuthology.orchestra.run.smithi176.stderr: 2450K .......... .......... .......... .......... .......... 2% 21.8M 7s 2020-04-28T13:00:00.309 INFO:teuthology.orchestra.run.smithi176.stderr: 2500K .......... .......... .......... .......... .......... 2% 32.8M 7s 2020-04-28T13:00:00.311 INFO:teuthology.orchestra.run.smithi176.stderr: 2550K .......... .......... .......... .......... .......... 2% 16.8M 7s 2020-04-28T13:00:00.313 INFO:teuthology.orchestra.run.smithi176.stderr: 2600K .......... .......... .......... .......... .......... 2% 21.8M 7s 2020-04-28T13:00:00.314 INFO:teuthology.orchestra.run.smithi176.stderr: 2650K .......... .......... .......... .......... .......... 2% 34.2M 6s 2020-04-28T13:00:00.316 INFO:teuthology.orchestra.run.smithi176.stderr: 2700K .......... .......... .......... .......... .......... 2% 24.0M 6s 2020-04-28T13:00:00.318 INFO:teuthology.orchestra.run.smithi176.stderr: 2750K .......... .......... .......... .......... .......... 3% 23.2M 6s 2020-04-28T13:00:00.320 INFO:teuthology.orchestra.run.smithi176.stderr: 2800K .......... .......... .......... .......... .......... 3% 31.9M 6s 2020-04-28T13:00:00.322 INFO:teuthology.orchestra.run.smithi176.stderr: 2850K .......... .......... .......... .......... .......... 3% 25.3M 6s 2020-04-28T13:00:00.325 INFO:teuthology.orchestra.run.smithi176.stderr: 2900K .......... .......... .......... .......... .......... 3% 23.6M 6s 2020-04-28T13:00:00.326 INFO:teuthology.orchestra.run.smithi176.stderr: 2950K .......... .......... .......... .......... .......... 3% 23.8M 6s 2020-04-28T13:00:00.328 INFO:teuthology.orchestra.run.smithi176.stderr: 3000K .......... .......... .......... .......... .......... 3% 25.0M 6s 2020-04-28T13:00:00.330 INFO:teuthology.orchestra.run.smithi176.stderr: 3050K .......... .......... .......... .......... .......... 3% 25.1M 6s 2020-04-28T13:00:00.332 INFO:teuthology.orchestra.run.smithi176.stderr: 3100K .......... .......... .......... .......... .......... 3% 27.7M 6s 2020-04-28T13:00:00.333 INFO:teuthology.orchestra.run.smithi176.stderr: 3150K .......... .......... .......... .......... .......... 3% 35.9M 6s 2020-04-28T13:00:00.335 INFO:teuthology.orchestra.run.smithi176.stderr: 3200K .......... .......... .......... .......... .......... 3% 23.7M 6s 2020-04-28T13:00:00.337 INFO:teuthology.orchestra.run.smithi176.stderr: 3250K .......... .......... .......... .......... .......... 3% 30.6M 6s 2020-04-28T13:00:00.338 INFO:teuthology.orchestra.run.smithi176.stderr: 3300K .......... .......... .......... .......... .......... 3% 38.2M 6s 2020-04-28T13:00:00.340 INFO:teuthology.orchestra.run.smithi176.stderr: 3350K .......... .......... .......... .......... .......... 3% 21.3M 6s 2020-04-28T13:00:00.342 INFO:teuthology.orchestra.run.smithi176.stderr: 3400K .......... .......... .......... .......... .......... 3% 28.1M 6s 2020-04-28T13:00:00.343 INFO:teuthology.orchestra.run.smithi176.stderr: 3450K .......... .......... .......... .......... .......... 3% 40.0M 6s 2020-04-28T13:00:00.345 INFO:teuthology.orchestra.run.smithi176.stderr: 3500K .......... .......... .......... .......... .......... 3% 28.9M 6s 2020-04-28T13:00:00.347 INFO:teuthology.orchestra.run.smithi176.stderr: 3550K .......... .......... .......... .......... .......... 3% 28.0M 6s 2020-04-28T13:00:00.349 INFO:teuthology.orchestra.run.smithi176.stderr: 3600K .......... .......... .......... .......... .......... 3% 41.1M 6s 2020-04-28T13:00:00.350 INFO:teuthology.orchestra.run.smithi176.stderr: 3650K .......... .......... .......... .......... .......... 3% 30.5M 6s 2020-04-28T13:00:00.351 INFO:teuthology.orchestra.run.smithi176.stderr: 3700K .......... .......... .......... .......... .......... 4% 28.5M 5s 2020-04-28T13:00:00.353 INFO:teuthology.orchestra.run.smithi176.stderr: 3750K .......... .......... .......... .......... .......... 4% 30.2M 5s 2020-04-28T13:00:00.354 INFO:teuthology.orchestra.run.smithi176.stderr: 3800K .......... .......... .......... .......... .......... 4% 31.0M 5s 2020-04-28T13:00:00.356 INFO:teuthology.orchestra.run.smithi176.stderr: 3850K .......... .......... .......... .......... .......... 4% 32.2M 5s 2020-04-28T13:00:00.358 INFO:teuthology.orchestra.run.smithi176.stderr: 3900K .......... .......... .......... .......... .......... 4% 29.9M 5s 2020-04-28T13:00:00.358 INFO:teuthology.orchestra.run.smithi176.stderr: 3950K .......... .......... .......... .......... .......... 4% 45.7M 5s 2020-04-28T13:00:00.360 INFO:teuthology.orchestra.run.smithi176.stderr: 4000K .......... .......... .......... .......... .......... 4% 28.8M 5s 2020-04-28T13:00:00.361 INFO:teuthology.orchestra.run.smithi176.stderr: 4050K .......... .......... .......... .......... .......... 4% 37.6M 5s 2020-04-28T13:00:00.363 INFO:teuthology.orchestra.run.smithi176.stderr: 4100K .......... .......... .......... .......... .......... 4% 44.6M 5s 2020-04-28T13:00:00.365 INFO:teuthology.orchestra.run.smithi176.stderr: 4150K .......... .......... .......... .......... .......... 4% 23.8M 5s 2020-04-28T13:00:00.366 INFO:teuthology.orchestra.run.smithi176.stderr: 4200K .......... .......... .......... .......... .......... 4% 38.1M 5s 2020-04-28T13:00:00.367 INFO:teuthology.orchestra.run.smithi176.stderr: 4250K .......... .......... .......... .......... .......... 4% 46.1M 5s 2020-04-28T13:00:00.369 INFO:teuthology.orchestra.run.smithi176.stderr: 4300K .......... .......... .......... .......... .......... 4% 31.7M 5s 2020-04-28T13:00:00.370 INFO:teuthology.orchestra.run.smithi176.stderr: 4350K .......... .......... .......... .......... .......... 4% 39.1M 5s 2020-04-28T13:00:00.372 INFO:teuthology.orchestra.run.smithi176.stderr: 4400K .......... .......... .......... .......... .......... 4% 29.0M 5s 2020-04-28T13:00:00.372 INFO:teuthology.orchestra.run.smithi176.stderr: 4450K .......... .......... .......... .......... .......... 4% 57.6M 5s 2020-04-28T13:00:00.374 INFO:teuthology.orchestra.run.smithi176.stderr: 4500K .......... .......... .......... .......... .......... 4% 40.3M 5s 2020-04-28T13:00:00.375 INFO:teuthology.orchestra.run.smithi176.stderr: 4550K .......... .......... .......... .......... .......... 4% 27.8M 5s 2020-04-28T13:00:00.376 INFO:teuthology.orchestra.run.smithi176.stderr: 4600K .......... .......... .......... .......... .......... 5% 42.9M 5s 2020-04-28T13:00:00.378 INFO:teuthology.orchestra.run.smithi176.stderr: 4650K .......... .......... .......... .......... .......... 5% 40.2M 5s 2020-04-28T13:00:00.379 INFO:teuthology.orchestra.run.smithi176.stderr: 4700K .......... .......... .......... .......... .......... 5% 37.9M 5s 2020-04-28T13:00:00.380 INFO:teuthology.orchestra.run.smithi176.stderr: 4750K .......... .......... .......... .......... .......... 5% 45.4M 5s 2020-04-28T13:00:00.381 INFO:teuthology.orchestra.run.smithi176.stderr: 4800K .......... .......... .......... .......... .......... 5% 62.1M 5s 2020-04-28T13:00:00.382 INFO:teuthology.orchestra.run.smithi176.stderr: 4850K .......... .......... .......... .......... .......... 5% 32.7M 5s 2020-04-28T13:00:00.384 INFO:teuthology.orchestra.run.smithi176.stderr: 4900K .......... .......... .......... .......... .......... 5% 35.4M 5s 2020-04-28T13:00:00.385 INFO:teuthology.orchestra.run.smithi176.stderr: 4950K .......... .......... .......... .......... .......... 5% 33.4M 5s 2020-04-28T13:00:00.386 INFO:teuthology.orchestra.run.smithi176.stderr: 5000K .......... .......... .......... .......... .......... 5% 43.0M 5s 2020-04-28T13:00:00.388 INFO:teuthology.orchestra.run.smithi176.stderr: 5050K .......... .......... .......... .......... .......... 5% 38.2M 5s 2020-04-28T13:00:00.388 INFO:teuthology.orchestra.run.smithi176.stderr: 5100K .......... .......... .......... .......... .......... 5% 59.6M 5s 2020-04-28T13:00:00.390 INFO:teuthology.orchestra.run.smithi176.stderr: 5150K .......... .......... .......... .......... .......... 5% 38.3M 5s 2020-04-28T13:00:00.393 INFO:teuthology.orchestra.run.smithi176.stderr: 5200K .......... .......... .......... .......... .......... 5% 47.5M 5s 2020-04-28T13:00:00.393 INFO:teuthology.orchestra.run.smithi176.stderr: 5250K .......... .......... .......... .......... .......... 5% 35.5M 4s 2020-04-28T13:00:00.396 INFO:teuthology.orchestra.run.smithi176.stderr: 5300K .......... .......... .......... .......... .......... 5% 73.7M 4s 2020-04-28T13:00:00.396 INFO:teuthology.orchestra.run.smithi176.stderr: 5350K .......... .......... .......... .......... .......... 5% 36.0M 4s 2020-04-28T13:00:00.396 INFO:teuthology.orchestra.run.smithi176.stderr: 5400K .......... .......... .......... .......... .......... 5% 38.1M 4s 2020-04-28T13:00:00.397 INFO:teuthology.orchestra.run.smithi176.stderr: 5450K .......... .......... .......... .......... .......... 5% 38.0M 4s 2020-04-28T13:00:00.398 INFO:teuthology.orchestra.run.smithi176.stderr: 5500K .......... .......... .......... .......... .......... 5% 51.0M 4s 2020-04-28T13:00:00.398 INFO:teuthology.orchestra.run.smithi176.stderr: 5550K .......... .......... .......... .......... .......... 6% 73.6M 4s 2020-04-28T13:00:00.400 INFO:teuthology.orchestra.run.smithi176.stderr: 5600K .......... .......... .......... .......... .......... 6% 38.8M 4s 2020-04-28T13:00:00.401 INFO:teuthology.orchestra.run.smithi176.stderr: 5650K .......... .......... .......... .......... .......... 6% 40.9M 4s 2020-04-28T13:00:00.402 INFO:teuthology.orchestra.run.smithi176.stderr: 5700K .......... .......... .......... .......... .......... 6% 49.3M 4s 2020-04-28T13:00:00.404 INFO:teuthology.orchestra.run.smithi176.stderr: 5750K .......... .......... .......... .......... .......... 6% 34.6M 4s 2020-04-28T13:00:00.404 INFO:teuthology.orchestra.run.smithi176.stderr: 5800K .......... .......... .......... .......... .......... 6% 87.1M 4s 2020-04-28T13:00:00.405 INFO:teuthology.orchestra.run.smithi176.stderr: 5850K .......... .......... .......... .......... .......... 6% 42.9M 4s 2020-04-28T13:00:00.406 INFO:teuthology.orchestra.run.smithi176.stderr: 5900K .......... .......... .......... .......... .......... 6% 41.1M 4s 2020-04-28T13:00:00.407 INFO:teuthology.orchestra.run.smithi176.stderr: 5950K .......... .......... .......... .......... .......... 6% 49.9M 4s 2020-04-28T13:00:00.408 INFO:teuthology.orchestra.run.smithi176.stderr: 6000K .......... .......... .......... .......... .......... 6% 79.8M 4s 2020-04-28T13:00:00.409 INFO:teuthology.orchestra.run.smithi176.stderr: 6050K .......... .......... .......... .......... .......... 6% 43.5M 4s 2020-04-28T13:00:00.410 INFO:teuthology.orchestra.run.smithi176.stderr: 6100K .......... .......... .......... .......... .......... 6% 44.3M 4s 2020-04-28T13:00:00.411 INFO:teuthology.orchestra.run.smithi176.stderr: 6150K .......... .......... .......... .......... .......... 6% 39.8M 4s 2020-04-28T13:00:00.412 INFO:teuthology.orchestra.run.smithi176.stderr: 6200K .......... .......... .......... .......... .......... 6% 52.5M 4s 2020-04-28T13:00:00.413 INFO:teuthology.orchestra.run.smithi176.stderr: 6250K .......... .......... .......... .......... .......... 6% 83.2M 4s 2020-04-28T13:00:00.414 INFO:teuthology.orchestra.run.smithi176.stderr: 6300K .......... .......... .......... .......... .......... 6% 44.5M 4s 2020-04-28T13:00:00.415 INFO:teuthology.orchestra.run.smithi176.stderr: 6350K .......... .......... .......... .......... .......... 6% 45.4M 4s 2020-04-28T13:00:00.416 INFO:teuthology.orchestra.run.smithi176.stderr: 6400K .......... .......... .......... .......... .......... 6% 45.2M 4s 2020-04-28T13:00:00.417 INFO:teuthology.orchestra.run.smithi176.stderr: 6450K .......... .......... .......... .......... .......... 6% 50.7M 4s 2020-04-28T13:00:00.418 INFO:teuthology.orchestra.run.smithi176.stderr: 6500K .......... .......... .......... .......... .......... 7% 82.5M 4s 2020-04-28T13:00:00.419 INFO:teuthology.orchestra.run.smithi176.stderr: 6550K .......... .......... .......... .......... .......... 7% 43.9M 4s 2020-04-28T13:00:00.422 INFO:teuthology.orchestra.run.smithi176.stderr: 6600K .......... .......... .......... .......... .......... 7% 49.8M 4s 2020-04-28T13:00:00.422 INFO:teuthology.orchestra.run.smithi176.stderr: 6650K .......... .......... .......... .......... .......... 7% 44.4M 4s 2020-04-28T13:00:00.425 INFO:teuthology.orchestra.run.smithi176.stderr: 6700K .......... .......... .......... .......... .......... 7% 58.6M 4s 2020-04-28T13:00:00.426 INFO:teuthology.orchestra.run.smithi176.stderr: 6750K .......... .......... .......... .......... .......... 7% 72.7M 4s 2020-04-28T13:00:00.426 INFO:teuthology.orchestra.run.smithi176.stderr: 6800K .......... .......... .......... .......... .......... 7% 55.5M 4s 2020-04-28T13:00:00.426 INFO:teuthology.orchestra.run.smithi176.stderr: 6850K .......... .......... .......... .......... .......... 7% 48.7M 4s 2020-04-28T13:00:00.426 INFO:teuthology.orchestra.run.smithi176.stderr: 6900K .......... .......... .......... .......... .......... 7% 50.3M 4s 2020-04-28T13:00:00.428 INFO:teuthology.orchestra.run.smithi176.stderr: 6950K .......... .......... .......... .......... .......... 7% 45.4M 4s 2020-04-28T13:00:00.428 INFO:teuthology.orchestra.run.smithi176.stderr: 7000K .......... .......... .......... .......... .......... 7% 111M 4s 2020-04-28T13:00:00.428 INFO:teuthology.orchestra.run.smithi176.stderr: 7050K .......... .......... .......... .......... .......... 7% 45.8M 4s 2020-04-28T13:00:00.430 INFO:teuthology.orchestra.run.smithi176.stderr: 7100K .......... .......... .......... .......... .......... 7% 52.2M 4s 2020-04-28T13:00:00.430 INFO:teuthology.orchestra.run.smithi176.stderr: 7150K .......... .......... .......... .......... .......... 7% 55.7M 4s 2020-04-28T13:00:00.430 INFO:teuthology.orchestra.run.smithi176.stderr: 7200K .......... .......... .......... .......... .......... 7% 112M 4s 2020-04-28T13:00:00.431 INFO:teuthology.orchestra.run.smithi176.stderr: 7250K .......... .......... .......... .......... .......... 7% 48.8M 4s 2020-04-28T13:00:00.432 INFO:teuthology.orchestra.run.smithi176.stderr: 7300K .......... .......... .......... .......... .......... 7% 57.0M 4s 2020-04-28T13:00:00.435 INFO:teuthology.orchestra.run.smithi176.stderr: 7350K .......... .......... .......... .......... .......... 7% 44.9M 4s 2020-04-28T13:00:00.435 INFO:teuthology.orchestra.run.smithi176.stderr: 7400K .......... .......... .......... .......... .......... 8% 47.1M 4s 2020-04-28T13:00:00.435 INFO:teuthology.orchestra.run.smithi176.stderr: 7450K .......... .......... .......... .......... .......... 8% 118M 4s 2020-04-28T13:00:00.436 INFO:teuthology.orchestra.run.smithi176.stderr: 7500K .......... .......... .......... .......... .......... 8% 63.2M 4s 2020-04-28T13:00:00.438 INFO:teuthology.orchestra.run.smithi176.stderr: 7550K .......... .......... .......... .......... .......... 8% 46.4M 4s 2020-04-28T13:00:00.438 INFO:teuthology.orchestra.run.smithi176.stderr: 7600K .......... .......... .......... .......... .......... 8% 65.7M 4s 2020-04-28T13:00:00.439 INFO:teuthology.orchestra.run.smithi176.stderr: 7650K .......... .......... .......... .......... .......... 8% 107M 4s 2020-04-28T13:00:00.439 INFO:teuthology.orchestra.run.smithi176.stderr: 7700K .......... .......... .......... .......... .......... 8% 58.8M 3s 2020-04-28T13:00:00.441 INFO:teuthology.orchestra.run.smithi176.stderr: 7750K .......... .......... .......... .......... .......... 8% 49.6M 3s 2020-04-28T13:00:00.441 INFO:teuthology.orchestra.run.smithi176.stderr: 7800K .......... .......... .......... .......... .......... 8% 49.9M 3s 2020-04-28T13:00:00.441 INFO:teuthology.orchestra.run.smithi176.stderr: 7850K .......... .......... .......... .......... .......... 8% 63.1M 3s 2020-04-28T13:00:00.444 INFO:teuthology.orchestra.run.smithi176.stderr: 7900K .......... .......... .......... .......... .......... 8% 52.3M 3s 2020-04-28T13:00:00.444 INFO:teuthology.orchestra.run.smithi176.stderr: 7950K .......... .......... .......... .......... .......... 8% 110M 3s 2020-04-28T13:00:00.445 INFO:teuthology.orchestra.run.smithi176.stderr: 8000K .......... .......... .......... .......... .......... 8% 61.1M 3s 2020-04-28T13:00:00.445 INFO:teuthology.orchestra.run.smithi176.stderr: 8050K .......... .......... .......... .......... .......... 8% 57.7M 3s 2020-04-28T13:00:00.451 INFO:teuthology.orchestra.run.smithi176.stderr: 8100K .......... .......... .......... .......... .......... 8% 56.6M 3s 2020-04-28T13:00:00.451 INFO:teuthology.orchestra.run.smithi176.stderr: 8150K .......... .......... .......... .......... .......... 8% 53.9M 3s 2020-04-28T13:00:00.451 INFO:teuthology.orchestra.run.smithi176.stderr: 8200K .......... .......... .......... .......... .......... 8% 109M 3s 2020-04-28T13:00:00.451 INFO:teuthology.orchestra.run.smithi176.stderr: 8250K .......... .......... .......... .......... .......... 8% 60.7M 3s 2020-04-28T13:00:00.452 INFO:teuthology.orchestra.run.smithi176.stderr: 8300K .......... .......... .......... .......... .......... 8% 61.1M 3s 2020-04-28T13:00:00.452 INFO:teuthology.orchestra.run.smithi176.stderr: 8350K .......... .......... .......... .......... .......... 9% 59.5M 3s 2020-04-28T13:00:00.452 INFO:teuthology.orchestra.run.smithi176.stderr: 8400K .......... .......... .......... .......... .......... 9% 116M 3s 2020-04-28T13:00:00.452 INFO:teuthology.orchestra.run.smithi176.stderr: 8450K .......... .......... .......... .......... .......... 9% 56.7M 3s 2020-04-28T13:00:00.452 INFO:teuthology.orchestra.run.smithi176.stderr: 8500K .......... .......... .......... .......... .......... 9% 64.2M 3s 2020-04-28T13:00:00.457 INFO:teuthology.orchestra.run.smithi176.stderr: 8550K .......... .......... .......... .......... .......... 9% 52.8M 3s 2020-04-28T13:00:00.457 INFO:teuthology.orchestra.run.smithi176.stderr: 8600K .......... .......... .......... .......... .......... 9% 61.8M 3s 2020-04-28T13:00:00.457 INFO:teuthology.orchestra.run.smithi176.stderr: 8650K .......... .......... .......... .......... .......... 9% 117M 3s 2020-04-28T13:00:00.457 INFO:teuthology.orchestra.run.smithi176.stderr: 8700K .......... .......... .......... .......... .......... 9% 55.2M 3s 2020-04-28T13:00:00.458 INFO:teuthology.orchestra.run.smithi176.stderr: 8750K .......... .......... .......... .......... .......... 9% 65.5M 3s 2020-04-28T13:00:00.458 INFO:teuthology.orchestra.run.smithi176.stderr: 8800K .......... .......... .......... .......... .......... 9% 69.5M 3s 2020-04-28T13:00:00.458 INFO:teuthology.orchestra.run.smithi176.stderr: 8850K .......... .......... .......... .......... .......... 9% 61.6M 3s 2020-04-28T13:00:00.458 INFO:teuthology.orchestra.run.smithi176.stderr: 8900K .......... .......... .......... .......... .......... 9% 136M 3s 2020-04-28T13:00:00.458 INFO:teuthology.orchestra.run.smithi176.stderr: 8950K .......... .......... .......... .......... .......... 9% 50.9M 3s 2020-04-28T13:00:00.470 INFO:teuthology.orchestra.run.smithi176.stderr: 9000K .......... .......... .......... .......... .......... 9% 72.9M 3s 2020-04-28T13:00:00.470 INFO:teuthology.orchestra.run.smithi176.stderr: 9050K .......... .......... .......... .......... .......... 9% 63.4M 3s 2020-04-28T13:00:00.470 INFO:teuthology.orchestra.run.smithi176.stderr: 9100K .......... .......... .......... .......... .......... 9% 59.2M 3s 2020-04-28T13:00:00.470 INFO:teuthology.orchestra.run.smithi176.stderr: 9150K .......... .......... .......... .......... .......... 9% 114M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9200K .......... .......... .......... .......... .......... 9% 78.6M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9250K .......... .......... .......... .......... .......... 10% 67.8M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9300K .......... .......... .......... .......... .......... 10% 67.7M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9350K .......... .......... .......... .......... .......... 10% 57.8M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9400K .......... .......... .......... .......... .......... 10% 124M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9450K .......... .......... .......... .......... .......... 10% 55.9M 3s 2020-04-28T13:00:00.471 INFO:teuthology.orchestra.run.smithi176.stderr: 9500K .......... .......... .......... .......... .......... 10% 82.7M 3s 2020-04-28T13:00:00.472 INFO:teuthology.orchestra.run.smithi176.stderr: 9550K .......... .......... .......... .......... .......... 10% 72.3M 3s 2020-04-28T13:00:00.472 INFO:teuthology.orchestra.run.smithi176.stderr: 9600K .......... .......... .......... .......... .......... 10% 122M 3s 2020-04-28T13:00:00.472 INFO:teuthology.orchestra.run.smithi176.stderr: 9650K .......... .......... .......... .......... .......... 10% 69.7M 3s 2020-04-28T13:00:00.472 INFO:teuthology.orchestra.run.smithi176.stderr: 9700K .......... .......... .......... .......... .......... 10% 55.7M 3s 2020-04-28T13:00:00.472 INFO:teuthology.orchestra.run.smithi176.stderr: 9750K .......... .......... .......... .......... .......... 10% 72.8M 3s 2020-04-28T13:00:00.473 INFO:teuthology.orchestra.run.smithi176.stderr: 9800K .......... .......... .......... .......... .......... 10% 69.1M 3s 2020-04-28T13:00:00.473 INFO:teuthology.orchestra.run.smithi176.stderr: 9850K .......... .......... .......... .......... .......... 10% 75.7M 3s 2020-04-28T13:00:00.473 INFO:teuthology.orchestra.run.smithi176.stderr: 9900K .......... .......... .......... .......... .......... 10% 122M 3s 2020-04-28T13:00:00.522 INFO:teuthology.orchestra.run.smithi176.stderr: 9950K .......... .......... .......... .......... .......... 10% 62.9M 3s 2020-04-28T13:00:00.522 INFO:teuthology.orchestra.run.smithi176.stderr: 10000K .......... .......... .......... .......... .......... 10% 76.3M 3s 2020-04-28T13:00:00.522 INFO:teuthology.orchestra.run.smithi176.stderr: 10050K .......... .......... .......... .......... .......... 10% 84.1M 3s 2020-04-28T13:00:00.522 INFO:teuthology.orchestra.run.smithi176.stderr: 10100K .......... .......... .......... .......... .......... 10% 87.1M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10150K .......... .......... .......... .......... .......... 10% 61.7M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10200K .......... .......... .......... .......... .......... 11% 82.2M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10250K .......... .......... .......... .......... .......... 11% 85.5M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10300K .......... .......... .......... .......... .......... 11% 62.7M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10350K .......... .......... .......... .......... .......... 11% 117M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10400K .......... .......... .......... .......... .......... 11% 86.5M 3s 2020-04-28T13:00:00.523 INFO:teuthology.orchestra.run.smithi176.stderr: 10450K .......... .......... .......... .......... .......... 11% 75.7M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10500K .......... .......... .......... .......... .......... 11% 73.3M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10550K .......... .......... .......... .......... .......... 11% 70.9M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10600K .......... .......... .......... .......... .......... 11% 67.2M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10650K .......... .......... .......... .......... .......... 11% 128M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10700K .......... .......... .......... .......... .......... 11% 71.4M 3s 2020-04-28T13:00:00.524 INFO:teuthology.orchestra.run.smithi176.stderr: 10750K .......... .......... .......... .......... .......... 11% 86.7M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 10800K .......... .......... .......... .......... .......... 11% 71.9M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 10850K .......... .......... .......... .......... .......... 11% 127M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 10900K .......... .......... .......... .......... .......... 11% 84.1M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 10950K .......... .......... .......... .......... .......... 11% 61.4M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 11000K .......... .......... .......... .......... .......... 11% 90.9M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 11050K .......... .......... .......... .......... .......... 11% 69.6M 3s 2020-04-28T13:00:00.525 INFO:teuthology.orchestra.run.smithi176.stderr: 11100K .......... .......... .......... .......... .......... 12% 117M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11150K .......... .......... .......... .......... .......... 12% 78.6M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11200K .......... .......... .......... .......... .......... 12% 88.5M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11250K .......... .......... .......... .......... .......... 12% 69.7M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11300K .......... .......... .......... .......... .......... 12% 124M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11350K .......... .......... .......... .......... .......... 12% 60.1M 3s 2020-04-28T13:00:00.526 INFO:teuthology.orchestra.run.smithi176.stderr: 11400K .......... .......... .......... .......... .......... 12% 123M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11450K .......... .......... .......... .......... .......... 12% 82.3M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11500K .......... .......... .......... .......... .......... 12% 68.8M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11550K .......... .......... .......... .......... .......... 12% 71.3M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11600K .......... .......... .......... .......... .......... 12% 122M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11650K .......... .......... .......... .......... .......... 12% 75.0M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11700K .......... .......... .......... .......... .......... 12% 92.3M 3s 2020-04-28T13:00:00.527 INFO:teuthology.orchestra.run.smithi176.stderr: 11750K .......... .......... .......... .......... .......... 12% 58.9M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 11800K .......... .......... .......... .......... .......... 12% 83.2M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 11850K .......... .......... .......... .......... .......... 12% 112M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 11900K .......... .......... .......... .......... .......... 12% 89.7M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 11950K .......... .......... .......... .......... .......... 12% 79.5M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 12000K .......... .......... .......... .......... .......... 12% 91.9M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 12050K .......... .......... .......... .......... .......... 13% 114M 3s 2020-04-28T13:00:00.528 INFO:teuthology.orchestra.run.smithi176.stderr: 12100K .......... .......... .......... .......... .......... 13% 79.9M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12150K .......... .......... .......... .......... .......... 13% 64.0M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12200K .......... .......... .......... .......... .......... 13% 71.9M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12250K .......... .......... .......... .......... .......... 13% 98.0M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12300K .......... .......... .......... .......... .......... 13% 78.3M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12350K .......... .......... .......... .......... .......... 13% 102M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12400K .......... .......... .......... .......... .......... 13% 85.6M 2s 2020-04-28T13:00:00.529 INFO:teuthology.orchestra.run.smithi176.stderr: 12450K .......... .......... .......... .......... .......... 13% 78.6M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12500K .......... .......... .......... .......... .......... 13% 85.9M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12550K .......... .......... .......... .......... .......... 13% 62.0M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12600K .......... .......... .......... .......... .......... 13% 129M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12650K .......... .......... .......... .......... .......... 13% 82.3M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12700K .......... .......... .......... .......... .......... 13% 79.2M 2s 2020-04-28T13:00:00.530 INFO:teuthology.orchestra.run.smithi176.stderr: 12750K .......... .......... .......... .......... .......... 13% 80.3M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 12800K .......... .......... .......... .......... .......... 13% 107M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 12850K .......... .......... .......... .......... .......... 13% 80.0M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 12900K .......... .......... .......... .......... .......... 13% 92.8M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 12950K .......... .......... .......... .......... .......... 13% 67.7M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 13000K .......... .......... .......... .......... .......... 14% 83.6M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 13050K .......... .......... .......... .......... .......... 14% 90.4M 2s 2020-04-28T13:00:00.531 INFO:teuthology.orchestra.run.smithi176.stderr: 13100K .......... .......... .......... .......... .......... 14% 110M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13150K .......... .......... .......... .......... .......... 14% 84.9M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13200K .......... .......... .......... .......... .......... 14% 83.6M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13250K .......... .......... .......... .......... .......... 14% 81.0M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13300K .......... .......... .......... .......... .......... 14% 94.1M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13350K .......... .......... .......... .......... .......... 14% 71.8M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13400K .......... .......... .......... .......... .......... 14% 106M 2s 2020-04-28T13:00:00.532 INFO:teuthology.orchestra.run.smithi176.stderr: 13450K .......... .......... .......... .......... .......... 14% 84.3M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13500K .......... .......... .......... .......... .......... 14% 74.9M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13550K .......... .......... .......... .......... .......... 14% 51.6M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13600K .......... .......... .......... .......... .......... 14% 209M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13650K .......... .......... .......... .......... .......... 14% 126M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13700K .......... .......... .......... .......... .......... 14% 84.4M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13750K .......... .......... .......... .......... .......... 14% 64.7M 2s 2020-04-28T13:00:00.533 INFO:teuthology.orchestra.run.smithi176.stderr: 13800K .......... .......... .......... .......... .......... 14% 119M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 13850K .......... .......... .......... .......... .......... 14% 116M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 13900K .......... .......... .......... .......... .......... 15% 71.8M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 13950K .......... .......... .......... .......... .......... 15% 83.6M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 14000K .......... .......... .......... .......... .......... 15% 74.0M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 14050K .......... .......... .......... .......... .......... 15% 104M 2s 2020-04-28T13:00:00.534 INFO:teuthology.orchestra.run.smithi176.stderr: 14100K .......... .......... .......... .......... .......... 15% 99.0M 2s 2020-04-28T13:00:00.535 INFO:teuthology.orchestra.run.smithi176.stderr: 14150K .......... .......... .......... .......... .......... 15% 76.2M 2s 2020-04-28T13:00:01.559 INFO:teuthology.orchestra.run.smithi176.stderr: 14200K .......... .......... .......... .......... .......... 15% 12.1M 2s 2020-04-28T13:00:01.559 INFO:teuthology.orchestra.run.smithi176.stderr: 14250K .......... .......... .......... .......... .......... 15% 182M 2s 2020-04-28T13:00:01.559 INFO:teuthology.orchestra.run.smithi176.stderr: 14300K .......... .......... .......... .......... .......... 15% 193M 2s 2020-04-28T13:00:01.559 INFO:teuthology.orchestra.run.smithi176.stderr: 14350K .......... .......... .......... .......... .......... 15% 187M 2s 2020-04-28T13:00:01.559 INFO:teuthology.orchestra.run.smithi176.stderr: 14400K .......... .......... .......... .......... .......... 15% 223M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14450K .......... .......... .......... .......... .......... 15% 222M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14500K .......... .......... .......... .......... .......... 15% 205M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14550K .......... .......... .......... .......... .......... 15% 178M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14600K .......... .......... .......... .......... .......... 15% 201M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14650K .......... .......... .......... .......... .......... 15% 195M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14700K .......... .......... .......... .......... .......... 15% 186M 2s 2020-04-28T13:00:01.560 INFO:teuthology.orchestra.run.smithi176.stderr: 14750K .......... .......... .......... .......... .......... 15% 135M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 14800K .......... .......... .......... .......... .......... 15% 201M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 14850K .......... .......... .......... .......... .......... 16% 89.7M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 14900K .......... .......... .......... .......... .......... 16% 79.1M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 14950K .......... .......... .......... .......... .......... 16% 72.9M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 15000K .......... .......... .......... .......... .......... 16% 66.0M 2s 2020-04-28T13:00:01.561 INFO:teuthology.orchestra.run.smithi176.stderr: 15050K .......... .......... .......... .......... .......... 16% 120M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15100K .......... .......... .......... .......... .......... 16% 70.5M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15150K .......... .......... .......... .......... .......... 16% 64.0M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15200K .......... .......... .......... .......... .......... 16% 70.3M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15250K .......... .......... .......... .......... .......... 16% 122M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15300K .......... .......... .......... .......... .......... 16% 65.7M 2s 2020-04-28T13:00:01.562 INFO:teuthology.orchestra.run.smithi176.stderr: 15350K .......... .......... .......... .......... .......... 16% 60.5M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15400K .......... .......... .......... .......... .......... 16% 67.2M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15450K .......... .......... .......... .......... .......... 16% 71.6M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15500K .......... .......... .......... .......... .......... 16% 105M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15550K .......... .......... .......... .......... .......... 16% 86.9M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15600K .......... .......... .......... .......... .......... 16% 64.8M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15650K .......... .......... .......... .......... .......... 16% 71.7M 2s 2020-04-28T13:00:01.563 INFO:teuthology.orchestra.run.smithi176.stderr: 15700K .......... .......... .......... .......... .......... 16% 67.2M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 15750K .......... .......... .......... .......... .......... 17% 64.8M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 15800K .......... .......... .......... .......... .......... 17% 101M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 15850K .......... .......... .......... .......... .......... 17% 79.5M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 15900K .......... .......... .......... .......... .......... 17% 79.4M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 15950K .......... .......... .......... .......... .......... 17% 76.8M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 16000K .......... .......... .......... .......... .......... 17% 116M 2s 2020-04-28T13:00:01.564 INFO:teuthology.orchestra.run.smithi176.stderr: 16050K .......... .......... .......... .......... .......... 17% 103M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16100K .......... .......... .......... .......... .......... 17% 65.6M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16150K .......... .......... .......... .......... .......... 17% 76.3M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16200K .......... .......... .......... .......... .......... 17% 85.0M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16250K .......... .......... .......... .......... .......... 17% 121M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16300K .......... .......... .......... .......... .......... 17% 63.8M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16350K .......... .......... .......... .......... .......... 17% 88.3M 2s 2020-04-28T13:00:01.565 INFO:teuthology.orchestra.run.smithi176.stderr: 16400K .......... .......... .......... .......... .......... 17% 81.1M 2s 2020-04-28T13:00:01.566 INFO:teuthology.orchestra.run.smithi176.stderr: 16450K .......... .......... .......... .......... .......... 17% 72.8M 2s 2020-04-28T13:00:01.566 INFO:teuthology.orchestra.run.smithi176.stderr: 16500K .......... .......... .......... .......... .......... 17% 129M 2s 2020-04-28T13:00:01.566 INFO:teuthology.orchestra.run.smithi176.stderr: 16550K .......... .......... .......... .......... .......... 17% 68.5M 2s 2020-04-28T13:00:01.566 INFO:teuthology.orchestra.run.smithi176.stderr: 16600K .......... .......... .......... .......... .......... 17% 64.1M 2s 2020-04-28T13:00:01.566 INFO:teuthology.orchestra.run.smithi176.stderr: 16650K .......... .......... .......... .......... .......... 17% 84.0M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16700K .......... .......... .......... .......... .......... 18% 81.5M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16750K .......... .......... .......... .......... .......... 18% 120M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16800K .......... .......... .......... .......... .......... 18% 88.3M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16850K .......... .......... .......... .......... .......... 18% 70.6M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16900K .......... .......... .......... .......... .......... 18% 82.6M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 16950K .......... .......... .......... .......... .......... 18% 68.0M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 17000K .......... .......... .......... .......... .......... 18% 119M 2s 2020-04-28T13:00:01.567 INFO:teuthology.orchestra.run.smithi176.stderr: 17050K .......... .......... .......... .......... .......... 18% 85.5M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17100K .......... .......... .......... .......... .......... 18% 68.8M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17150K .......... .......... .......... .......... .......... 18% 76.0M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17200K .......... .......... .......... .......... .......... 18% 120M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17250K .......... .......... .......... .......... .......... 18% 79.0M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17300K .......... .......... .......... .......... .......... 18% 86.7M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17350K .......... .......... .......... .......... .......... 18% 64.6M 2s 2020-04-28T13:00:01.568 INFO:teuthology.orchestra.run.smithi176.stderr: 17400K .......... .......... .......... .......... .......... 18% 88.5M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17450K .......... .......... .......... .......... .......... 18% 84.8M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17500K .......... .......... .......... .......... .......... 18% 114M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17550K .......... .......... .......... .......... .......... 18% 70.1M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17600K .......... .......... .......... .......... .......... 18% 79.3M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17650K .......... .......... .......... .......... .......... 19% 86.8M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17700K .......... .......... .......... .......... .......... 19% 119M 2s 2020-04-28T13:00:01.569 INFO:teuthology.orchestra.run.smithi176.stderr: 17750K .......... .......... .......... .......... .......... 19% 63.1M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 17800K .......... .......... .......... .......... .......... 19% 87.9M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 17850K .......... .......... .......... .......... .......... 19% 71.3M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 17900K .......... .......... .......... .......... .......... 19% 100M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 17950K .......... .......... .......... .......... .......... 19% 97.8M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 18000K .......... .......... .......... .......... .......... 19% 79.5M 2s 2020-04-28T13:00:01.570 INFO:teuthology.orchestra.run.smithi176.stderr: 18050K .......... .......... .......... .......... .......... 19% 93.8M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18100K .......... .......... .......... .......... .......... 19% 71.1M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18150K .......... .......... .......... .......... .......... 19% 66.3M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18200K .......... .......... .......... .......... .......... 19% 73.5M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18250K .......... .......... .......... .......... .......... 19% 110M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18300K .......... .......... .......... .......... .......... 19% 79.0M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18350K .......... .......... .......... .......... .......... 19% 81.6M 2s 2020-04-28T13:00:01.571 INFO:teuthology.orchestra.run.smithi176.stderr: 18400K .......... .......... .......... .......... .......... 19% 78.7M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18450K .......... .......... .......... .......... .......... 19% 121M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18500K .......... .......... .......... .......... .......... 19% 55.7M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18550K .......... .......... .......... .......... .......... 20% 69.6M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18600K .......... .......... .......... .......... .......... 20% 89.7M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18650K .......... .......... .......... .......... .......... 20% 72.9M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18700K .......... .......... .......... .......... .......... 20% 118M 2s 2020-04-28T13:00:01.572 INFO:teuthology.orchestra.run.smithi176.stderr: 18750K .......... .......... .......... .......... .......... 20% 79.1M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 18800K .......... .......... .......... .......... .......... 20% 69.4M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 18850K .......... .......... .......... .......... .......... 20% 71.3M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 18900K .......... .......... .......... .......... .......... 20% 122M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 18950K .......... .......... .......... .......... .......... 20% 51.5M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 19000K .......... .......... .......... .......... .......... 20% 119M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 19050K .......... .......... .......... .......... .......... 20% 76.7M 2s 2020-04-28T13:00:01.573 INFO:teuthology.orchestra.run.smithi176.stderr: 19100K .......... .......... .......... .......... .......... 20% 77.7M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19150K .......... .......... .......... .......... .......... 20% 75.7M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19200K .......... .......... .......... .......... .......... 20% 121M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19250K .......... .......... .......... .......... .......... 20% 88.1M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19300K .......... .......... .......... .......... .......... 20% 73.5M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19350K .......... .......... .......... .......... .......... 20% 61.0M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19400K .......... .......... .......... .......... .......... 20% 92.4M 2s 2020-04-28T13:00:01.574 INFO:teuthology.orchestra.run.smithi176.stderr: 19450K .......... .......... .......... .......... .......... 20% 117M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19500K .......... .......... .......... .......... .......... 21% 76.0M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19550K .......... .......... .......... .......... .......... 21% 78.5M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19600K .......... .......... .......... .......... .......... 21% 91.2M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19650K .......... .......... .......... .......... .......... 21% 85.9M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19700K .......... .......... .......... .......... .......... 21% 81.6M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19750K .......... .......... .......... .......... .......... 21% 77.8M 2s 2020-04-28T13:00:01.575 INFO:teuthology.orchestra.run.smithi176.stderr: 19800K .......... .......... .......... .......... .......... 21% 69.2M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 19850K .......... .......... .......... .......... .......... 21% 92.7M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 19900K .......... .......... .......... .......... .......... 21% 75.2M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 19950K .......... .......... .......... .......... .......... 21% 111M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 20000K .......... .......... .......... .......... .......... 21% 70.0M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 20050K .......... .......... .......... .......... .......... 21% 90.8M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 20100K .......... .......... .......... .......... .......... 21% 80.5M 2s 2020-04-28T13:00:01.576 INFO:teuthology.orchestra.run.smithi176.stderr: 20150K .......... .......... .......... .......... .......... 21% 61.6M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20200K .......... .......... .......... .......... .......... 21% 114M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20250K .......... .......... .......... .......... .......... 21% 95.7M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20300K .......... .......... .......... .......... .......... 21% 86.3M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20350K .......... .......... .......... .......... .......... 21% 69.4M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20400K .......... .......... .......... .......... .......... 22% 91.1M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20450K .......... .......... .......... .......... .......... 22% 82.8M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20500K .......... .......... .......... .......... .......... 22% 79.8M 2s 2020-04-28T13:00:01.577 INFO:teuthology.orchestra.run.smithi176.stderr: 20550K .......... .......... .......... .......... .......... 22% 73.7M 2s 2020-04-28T13:00:01.578 INFO:teuthology.orchestra.run.smithi176.stderr: 20600K .......... .......... .......... .......... .......... 22% 77.8M 2s 2020-04-28T13:00:01.578 INFO:teuthology.orchestra.run.smithi176.stderr: 20650K .......... .......... .......... .......... .......... 22% 80.0M 2s 2020-04-28T13:00:01.578 INFO:teuthology.orchestra.run.smithi176.stderr: 20700K .......... .......... .......... .......... .......... 22% 111M 2s 2020-04-28T13:00:01.578 INFO:teuthology.orchestra.run.smithi176.stderr: 20750K .......... .......... .......... .......... .......... 22% 80.2M 2s 2020-04-28T13:00:01.578 INFO:teuthology.orchestra.run.smithi176.stderr: 20800K .......... .......... .......... .......... .......... 22% 77.5M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 20850K .......... .......... .......... .......... .......... 22% 81.4M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 20900K .......... .......... .......... .......... .......... 22% 118M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 20950K .......... .......... .......... .......... .......... 22% 64.2M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 21000K .......... .......... .......... .......... .......... 22% 85.5M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 21050K .......... .......... .......... .......... .......... 22% 78.6M 2s 2020-04-28T13:00:01.579 INFO:teuthology.orchestra.run.smithi176.stderr: 21100K .......... .......... .......... .......... .......... 22% 77.6M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21150K .......... .......... .......... .......... .......... 22% 109M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21200K .......... .......... .......... .......... .......... 22% 81.4M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21250K .......... .......... .......... .......... .......... 22% 79.4M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21300K .......... .......... .......... .......... .......... 22% 79.7M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21350K .......... .......... .......... .......... .......... 23% 60.3M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21400K .......... .......... .......... .......... .......... 23% 125M 2s 2020-04-28T13:00:01.580 INFO:teuthology.orchestra.run.smithi176.stderr: 21450K .......... .......... .......... .......... .......... 23% 82.9M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21500K .......... .......... .......... .......... .......... 23% 79.9M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21550K .......... .......... .......... .......... .......... 23% 78.6M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21600K .......... .......... .......... .......... .......... 23% 69.4M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21650K .......... .......... .......... .......... .......... 23% 127M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21700K .......... .......... .......... .......... .......... 23% 85.8M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21750K .......... .......... .......... .......... .......... 23% 67.2M 2s 2020-04-28T13:00:01.581 INFO:teuthology.orchestra.run.smithi176.stderr: 21800K .......... .......... .......... .......... .......... 23% 95.1M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 21850K .......... .......... .......... .......... .......... 23% 69.2M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 21900K .......... .......... .......... .......... .......... 23% 115M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 21950K .......... .......... .......... .......... .......... 23% 68.4M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 22000K .......... .......... .......... .......... .......... 23% 81.1M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 22050K .......... .......... .......... .......... .......... 23% 89.8M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 22100K .......... .......... .......... .......... .......... 23% 115M 2s 2020-04-28T13:00:01.582 INFO:teuthology.orchestra.run.smithi176.stderr: 22150K .......... .......... .......... .......... .......... 23% 72.6M 2s 2020-04-28T13:00:01.583 INFO:teuthology.orchestra.run.smithi176.stderr: 22200K .......... .......... .......... .......... .......... 23% 68.1M 2s 2020-04-28T13:00:01.583 INFO:teuthology.orchestra.run.smithi176.stderr: 22250K .......... .......... .......... .......... .......... 24% 94.5M 2s 2020-04-28T13:00:01.583 INFO:teuthology.orchestra.run.smithi176.stderr: 22300K .......... .......... .......... .......... .......... 24% 67.4M 2s 2020-04-28T13:00:01.583 INFO:teuthology.orchestra.run.smithi176.stderr: 22350K .......... .......... .......... .......... .......... 24% 76.4M 2s 2020-04-28T13:00:01.583 INFO:teuthology.orchestra.run.smithi176.stderr: 22400K .......... .......... .......... .......... .......... 24% 117M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22450K .......... .......... .......... .......... .......... 24% 74.8M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22500K .......... .......... .......... .......... .......... 24% 97.2M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22550K .......... .......... .......... .......... .......... 24% 72.9M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22600K .......... .......... .......... .......... .......... 24% 66.3M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22650K .......... .......... .......... .......... .......... 24% 115M 2s 2020-04-28T13:00:01.584 INFO:teuthology.orchestra.run.smithi176.stderr: 22700K .......... .......... .......... .......... .......... 24% 84.9M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 22750K .......... .......... .......... .......... .......... 24% 76.0M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 22800K .......... .......... .......... .......... .......... 24% 70.6M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 22850K .......... .......... .......... .......... .......... 24% 123M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 22900K .......... .......... .......... .......... .......... 24% 92.6M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 22950K .......... .......... .......... .......... .......... 24% 74.6M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 23000K .......... .......... .......... .......... .......... 24% 75.7M 2s 2020-04-28T13:00:01.585 INFO:teuthology.orchestra.run.smithi176.stderr: 23050K .......... .......... .......... .......... .......... 24% 78.6M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23100K .......... .......... .......... .......... .......... 24% 98.4M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23150K .......... .......... .......... .......... .......... 24% 87.1M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23200K .......... .......... .......... .......... .......... 25% 82.9M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23250K .......... .......... .......... .......... .......... 25% 87.8M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23300K .......... .......... .......... .......... .......... 25% 70.5M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23350K .......... .......... .......... .......... .......... 25% 71.4M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23400K .......... .......... .......... .......... .......... 25% 115M 2s 2020-04-28T13:00:01.586 INFO:teuthology.orchestra.run.smithi176.stderr: 23450K .......... .......... .......... .......... .......... 25% 68.7M 2s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23500K .......... .......... .......... .......... .......... 25% 75.5M 2s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23550K .......... .......... .......... .......... .......... 25% 77.4M 2s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23600K .......... .......... .......... .......... .......... 25% 118M 1s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23650K .......... .......... .......... .......... .......... 25% 101M 1s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23700K .......... .......... .......... .......... .......... 25% 71.0M 1s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23750K .......... .......... .......... .......... .......... 25% 60.3M 1s 2020-04-28T13:00:01.587 INFO:teuthology.orchestra.run.smithi176.stderr: 23800K .......... .......... .......... .......... .......... 25% 98.9M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 23850K .......... .......... .......... .......... .......... 25% 113M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 23900K .......... .......... .......... .......... .......... 25% 69.2M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 23950K .......... .......... .......... .......... .......... 25% 77.2M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 24000K .......... .......... .......... .......... .......... 25% 72.7M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 24050K .......... .......... .......... .......... .......... 25% 78.2M 1s 2020-04-28T13:00:01.588 INFO:teuthology.orchestra.run.smithi176.stderr: 24100K .......... .......... .......... .......... .......... 25% 114M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24150K .......... .......... .......... .......... .......... 26% 68.9M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24200K .......... .......... .......... .......... .......... 26% 75.9M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24250K .......... .......... .......... .......... .......... 26% 78.9M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24300K .......... .......... .......... .......... .......... 26% 76.3M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24350K .......... .......... .......... .......... .......... 26% 105M 1s 2020-04-28T13:00:01.589 INFO:teuthology.orchestra.run.smithi176.stderr: 24400K .......... .......... .......... .......... .......... 26% 84.8M 1s 2020-04-28T13:00:01.590 INFO:teuthology.orchestra.run.smithi176.stderr: 24450K .......... .......... .......... .......... .......... 26% 79.0M 1s 2020-04-28T13:00:01.590 INFO:teuthology.orchestra.run.smithi176.stderr: 24500K .......... .......... .......... .......... .......... 26% 70.2M 1s 2020-04-28T13:00:01.590 INFO:teuthology.orchestra.run.smithi176.stderr: 24550K .......... .......... .......... .......... .......... 26% 85.0M 1s 2020-04-28T13:00:01.590 INFO:teuthology.orchestra.run.smithi176.stderr: 24600K .......... .......... .......... .......... .......... 26% 113M 1s 2020-04-28T13:00:01.590 INFO:teuthology.orchestra.run.smithi176.stderr: 24650K .......... .......... .......... .......... .......... 26% 93.8M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24700K .......... .......... .......... .......... .......... 26% 68.8M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24750K .......... .......... .......... .......... .......... 26% 76.9M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24800K .......... .......... .......... .......... .......... 26% 119M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24850K .......... .......... .......... .......... .......... 26% 81.4M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24900K .......... .......... .......... .......... .......... 26% 85.6M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 24950K .......... .......... .......... .......... .......... 26% 66.5M 1s 2020-04-28T13:00:01.591 INFO:teuthology.orchestra.run.smithi176.stderr: 25000K .......... .......... .......... .......... .......... 26% 73.2M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25050K .......... .......... .......... .......... .......... 27% 84.0M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25100K .......... .......... .......... .......... .......... 27% 112M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25150K .......... .......... .......... .......... .......... 27% 101M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25200K .......... .......... .......... .......... .......... 27% 70.2M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25250K .......... .......... .......... .......... .......... 27% 80.2M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25300K .......... .......... .......... .......... .......... 27% 127M 1s 2020-04-28T13:00:01.592 INFO:teuthology.orchestra.run.smithi176.stderr: 25350K .......... .......... .......... .......... .......... 27% 72.6M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25400K .......... .......... .......... .......... .......... 27% 93.3M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25450K .......... .......... .......... .......... .......... 27% 74.5M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25500K .......... .......... .......... .......... .......... 27% 87.7M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25550K .......... .......... .......... .......... .......... 27% 111M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25600K .......... .......... .......... .......... .......... 27% 82.7M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25650K .......... .......... .......... .......... .......... 27% 92.1M 1s 2020-04-28T13:00:01.593 INFO:teuthology.orchestra.run.smithi176.stderr: 25700K .......... .......... .......... .......... .......... 27% 84.9M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 25750K .......... .......... .......... .......... .......... 27% 69.7M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 25800K .......... .......... .......... .......... .......... 27% 86.7M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 25850K .......... .......... .......... .......... .......... 27% 117M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 25900K .......... .......... .......... .......... .......... 27% 84.7M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 25950K .......... .......... .......... .......... .......... 27% 91.1M 1s 2020-04-28T13:00:01.594 INFO:teuthology.orchestra.run.smithi176.stderr: 26000K .......... .......... .......... .......... .......... 28% 83.9M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26050K .......... .......... .......... .......... .......... 28% 121M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26100K .......... .......... .......... .......... .......... 28% 74.7M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26150K .......... .......... .......... .......... .......... 28% 70.7M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26200K .......... .......... .......... .......... .......... 28% 78.8M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26250K .......... .......... .......... .......... .......... 28% 112M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26300K .......... .......... .......... .......... .......... 28% 104M 1s 2020-04-28T13:00:01.595 INFO:teuthology.orchestra.run.smithi176.stderr: 26350K .......... .......... .......... .......... .......... 28% 72.4M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26400K .......... .......... .......... .......... .......... 28% 109M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26450K .......... .......... .......... .......... .......... 28% 71.3M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26500K .......... .......... .......... .......... .......... 28% 126M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26550K .......... .......... .......... .......... .......... 28% 66.5M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26600K .......... .......... .......... .......... .......... 28% 87.4M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26650K .......... .......... .......... .......... .......... 28% 87.1M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26700K .......... .......... .......... .......... .......... 28% 87.7M 1s 2020-04-28T13:00:01.596 INFO:teuthology.orchestra.run.smithi176.stderr: 26750K .......... .......... .......... .......... .......... 28% 90.9M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 26800K .......... .......... .......... .......... .......... 28% 116M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 26850K .......... .......... .......... .......... .......... 28% 76.4M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 26900K .......... .......... .......... .......... .......... 29% 92.9M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 26950K .......... .......... .......... .......... .......... 29% 67.4M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 27000K .......... .......... .......... .......... .......... 29% 80.8M 1s 2020-04-28T13:00:01.597 INFO:teuthology.orchestra.run.smithi176.stderr: 27050K .......... .......... .......... .......... .......... 29% 114M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27100K .......... .......... .......... .......... .......... 29% 97.2M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27150K .......... .......... .......... .......... .......... 29% 84.7M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27200K .......... .......... .......... .......... .......... 29% 75.6M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27250K .......... .......... .......... .......... .......... 29% 118M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27300K .......... .......... .......... .......... .......... 29% 68.3M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27350K .......... .......... .......... .......... .......... 29% 56.5M 1s 2020-04-28T13:00:01.598 INFO:teuthology.orchestra.run.smithi176.stderr: 27400K .......... .......... .......... .......... .......... 29% 76.7M 1s 2020-04-28T13:00:01.599 INFO:teuthology.orchestra.run.smithi176.stderr: 27450K .......... .......... .......... .......... .......... 29% 71.8M 1s 2020-04-28T13:00:01.599 INFO:teuthology.orchestra.run.smithi176.stderr: 27500K .......... .......... .......... .......... .......... 29% 75.1M 1s 2020-04-28T13:00:01.599 INFO:teuthology.orchestra.run.smithi176.stderr: 27550K .......... .......... .......... .......... .......... 29% 110M 1s 2020-04-28T13:00:01.599 INFO:teuthology.orchestra.run.smithi176.stderr: 27600K .......... .......... .......... .......... .......... 29% 63.0M 1s 2020-04-28T13:00:01.599 INFO:teuthology.orchestra.run.smithi176.stderr: 27650K .......... .......... .......... .......... .......... 29% 74.1M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27700K .......... .......... .......... .......... .......... 29% 81.2M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27750K .......... .......... .......... .......... .......... 29% 57.6M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27800K .......... .......... .......... .......... .......... 29% 113M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27850K .......... .......... .......... .......... .......... 30% 70.5M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27900K .......... .......... .......... .......... .......... 30% 77.7M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 27950K .......... .......... .......... .......... .......... 30% 69.2M 1s 2020-04-28T13:00:01.600 INFO:teuthology.orchestra.run.smithi176.stderr: 28000K .......... .......... .......... .......... .......... 30% 127M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28050K .......... .......... .......... .......... .......... 30% 77.6M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28100K .......... .......... .......... .......... .......... 30% 76.3M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28150K .......... .......... .......... .......... .......... 30% 51.8M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28200K .......... .......... .......... .......... .......... 30% 88.0M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28250K .......... .......... .......... .......... .......... 30% 71.0M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28300K .......... .......... .......... .......... .......... 30% 125M 1s 2020-04-28T13:00:01.601 INFO:teuthology.orchestra.run.smithi176.stderr: 28350K .......... .......... .......... .......... .......... 30% 71.8M 1s 2020-04-28T13:00:01.602 INFO:teuthology.orchestra.run.smithi176.stderr: 28400K .......... .......... .......... .......... .......... 30% 61.6M 1s 2020-04-28T13:00:01.602 INFO:teuthology.orchestra.run.smithi176.stderr: 28450K .......... .......... .......... .......... .......... 30% 82.2M 1s 2020-04-28T13:00:01.602 INFO:teuthology.orchestra.run.smithi176.stderr: 28500K .......... .......... .......... .......... .......... 30% 124M 1s 2020-04-28T13:00:01.602 INFO:teuthology.orchestra.run.smithi176.stderr: 28550K .......... .......... .......... .......... .......... 30% 61.4M 1s 2020-04-28T13:00:01.602 INFO:teuthology.orchestra.run.smithi176.stderr: 28600K .......... .......... .......... .......... .......... 30% 75.2M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28650K .......... .......... .......... .......... .......... 30% 111M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28700K .......... .......... .......... .......... .......... 30% 66.1M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28750K .......... .......... .......... .......... .......... 31% 113M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28800K .......... .......... .......... .......... .......... 31% 96.5M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28850K .......... .......... .......... .......... .......... 31% 67.0M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28900K .......... .......... .......... .......... .......... 31% 79.5M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 28950K .......... .......... .......... .......... .......... 31% 69.2M 1s 2020-04-28T13:00:01.603 INFO:teuthology.orchestra.run.smithi176.stderr: 29000K .......... .......... .......... .......... .......... 31% 109M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29050K .......... .......... .......... .......... .......... 31% 82.9M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29100K .......... .......... .......... .......... .......... 31% 82.8M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29150K .......... .......... .......... .......... .......... 31% 76.5M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29200K .......... .......... .......... .......... .......... 31% 80.8M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29250K .......... .......... .......... .......... .......... 31% 103M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29300K .......... .......... .......... .......... .......... 31% 84.4M 1s 2020-04-28T13:00:01.604 INFO:teuthology.orchestra.run.smithi176.stderr: 29350K .......... .......... .......... .......... .......... 31% 65.5M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29400K .......... .......... .......... .......... .......... 31% 81.6M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29450K .......... .......... .......... .......... .......... 31% 80.1M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29500K .......... .......... .......... .......... .......... 31% 121M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29550K .......... .......... .......... .......... .......... 31% 75.0M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29600K .......... .......... .......... .......... .......... 31% 80.3M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29650K .......... .......... .......... .......... .......... 31% 75.1M 1s 2020-04-28T13:00:01.605 INFO:teuthology.orchestra.run.smithi176.stderr: 29700K .......... .......... .......... .......... .......... 32% 107M 1s 2020-04-28T13:00:01.606 INFO:teuthology.orchestra.run.smithi176.stderr: 29750K .......... .......... .......... .......... .......... 32% 67.3M 1s 2020-04-28T13:00:01.606 INFO:teuthology.orchestra.run.smithi176.stderr: 29800K .......... .......... .......... .......... .......... 32% 65.3M 1s 2020-04-28T13:00:01.606 INFO:teuthology.orchestra.run.smithi176.stderr: 29850K .......... .......... .......... .......... .......... 32% 106M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 29900K .......... .......... .......... .......... .......... 32% 78.4M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 29950K .......... .......... .......... .......... .......... 32% 80.2M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 30000K .......... .......... .......... .......... .......... 32% 120M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 30050K .......... .......... .......... .......... .......... 32% 75.7M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 30100K .......... .......... .......... .......... .......... 32% 78.4M 1s 2020-04-28T13:00:01.607 INFO:teuthology.orchestra.run.smithi176.stderr: 30150K .......... .......... .......... .......... .......... 32% 72.8M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30200K .......... .......... .......... .......... .......... 32% 82.5M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30250K .......... .......... .......... .......... .......... 32% 120M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30300K .......... .......... .......... .......... .......... 32% 68.7M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30350K .......... .......... .......... .......... .......... 32% 92.4M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30400K .......... .......... .......... .......... .......... 32% 76.9M 1s 2020-04-28T13:00:01.608 INFO:teuthology.orchestra.run.smithi176.stderr: 30450K .......... .......... .......... .......... .......... 32% 115M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30500K .......... .......... .......... .......... .......... 32% 89.4M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30550K .......... .......... .......... .......... .......... 32% 64.8M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30600K .......... .......... .......... .......... .......... 32% 67.1M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30650K .......... .......... .......... .......... .......... 33% 88.3M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30700K .......... .......... .......... .......... .......... 33% 98.3M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30750K .......... .......... .......... .......... .......... 33% 88.3M 1s 2020-04-28T13:00:01.609 INFO:teuthology.orchestra.run.smithi176.stderr: 30800K .......... .......... .......... .......... .......... 33% 71.6M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 30850K .......... .......... .......... .......... .......... 33% 80.0M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 30900K .......... .......... .......... .......... .......... 33% 78.6M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 30950K .......... .......... .......... .......... .......... 33% 68.7M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 31000K .......... .......... .......... .......... .......... 33% 104M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 31050K .......... .......... .......... .......... .......... 33% 89.8M 1s 2020-04-28T13:00:01.610 INFO:teuthology.orchestra.run.smithi176.stderr: 31100K .......... .......... .......... .......... .......... 33% 77.7M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31150K .......... .......... .......... .......... .......... 33% 90.6M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31200K .......... .......... .......... .......... .......... 33% 116M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31250K .......... .......... .......... .......... .......... 33% 69.7M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31300K .......... .......... .......... .......... .......... 33% 79.5M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31350K .......... .......... .......... .......... .......... 33% 72.0M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31400K .......... .......... .......... .......... .......... 33% 76.4M 1s 2020-04-28T13:00:01.611 INFO:teuthology.orchestra.run.smithi176.stderr: 31450K .......... .......... .......... .......... .......... 33% 107M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31500K .......... .......... .......... .......... .......... 33% 90.7M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31550K .......... .......... .......... .......... .......... 34% 70.9M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31600K .......... .......... .......... .......... .......... 34% 86.1M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31650K .......... .......... .......... .......... .......... 34% 90.3M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31700K .......... .......... .......... .......... .......... 34% 96.9M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31750K .......... .......... .......... .......... .......... 34% 64.9M 1s 2020-04-28T13:00:01.612 INFO:teuthology.orchestra.run.smithi176.stderr: 31800K .......... .......... .......... .......... .......... 34% 89.2M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 31850K .......... .......... .......... .......... .......... 34% 83.4M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 31900K .......... .......... .......... .......... .......... 34% 60.9M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 31950K .......... .......... .......... .......... .......... 34% 140M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 32000K .......... .......... .......... .......... .......... 34% 78.9M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 32050K .......... .......... .......... .......... .......... 34% 77.0M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 32100K .......... .......... .......... .......... .......... 34% 91.2M 1s 2020-04-28T13:00:01.613 INFO:teuthology.orchestra.run.smithi176.stderr: 32150K .......... .......... .......... .......... .......... 34% 69.3M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32200K .......... .......... .......... .......... .......... 34% 110M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32250K .......... .......... .......... .......... .......... 34% 72.0M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32300K .......... .......... .......... .......... .......... 34% 85.5M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32350K .......... .......... .......... .......... .......... 34% 81.5M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32400K .......... .......... .......... .......... .......... 34% 126M 1s 2020-04-28T13:00:01.614 INFO:teuthology.orchestra.run.smithi176.stderr: 32450K .......... .......... .......... .......... .......... 34% 68.6M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32500K .......... .......... .......... .......... .......... 35% 66.7M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32550K .......... .......... .......... .......... .......... 35% 99.7M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32600K .......... .......... .......... .......... .......... 35% 62.2M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32650K .......... .......... .......... .......... .......... 35% 94.7M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32700K .......... .......... .......... .......... .......... 35% 121M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32750K .......... .......... .......... .......... .......... 35% 74.2M 1s 2020-04-28T13:00:01.615 INFO:teuthology.orchestra.run.smithi176.stderr: 32800K .......... .......... .......... .......... .......... 35% 83.9M 1s 2020-04-28T13:00:01.616 INFO:teuthology.orchestra.run.smithi176.stderr: 32850K .......... .......... .......... .......... .......... 35% 65.3M 1s 2020-04-28T13:00:01.616 INFO:teuthology.orchestra.run.smithi176.stderr: 32900K .......... .......... .......... .......... .......... 35% 138M 1s 2020-04-28T13:00:01.616 INFO:teuthology.orchestra.run.smithi176.stderr: 32950K .......... .......... .......... .......... .......... 35% 76.1M 1s 2020-04-28T13:00:01.616 INFO:teuthology.orchestra.run.smithi176.stderr: 33000K .......... .......... .......... .......... .......... 35% 72.3M 1s 2020-04-28T13:00:01.616 INFO:teuthology.orchestra.run.smithi176.stderr: 33050K .......... .......... .......... .......... .......... 35% 82.6M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33100K .......... .......... .......... .......... .......... 35% 73.4M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33150K .......... .......... .......... .......... .......... 35% 109M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33200K .......... .......... .......... .......... .......... 35% 80.5M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33250K .......... .......... .......... .......... .......... 35% 87.4M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33300K .......... .......... .......... .......... .......... 35% 73.8M 1s 2020-04-28T13:00:01.617 INFO:teuthology.orchestra.run.smithi176.stderr: 33350K .......... .......... .......... .......... .......... 35% 70.3M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33400K .......... .......... .......... .......... .......... 36% 69.8M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33450K .......... .......... .......... .......... .......... 36% 114M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33500K .......... .......... .......... .......... .......... 36% 86.6M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33550K .......... .......... .......... .......... .......... 36% 90.3M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33600K .......... .......... .......... .......... .......... 36% 65.0M 1s 2020-04-28T13:00:01.618 INFO:teuthology.orchestra.run.smithi176.stderr: 33650K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33700K .......... .......... .......... .......... .......... 36% 82.3M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33750K .......... .......... .......... .......... .......... 36% 61.5M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33800K .......... .......... .......... .......... .......... 36% 86.6M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33850K .......... .......... .......... .......... .......... 36% 90.8M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33900K .......... .......... .......... .......... .......... 36% 116M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 33950K .......... .......... .......... .......... .......... 36% 68.5M 1s 2020-04-28T13:00:01.619 INFO:teuthology.orchestra.run.smithi176.stderr: 34000K .......... .......... .......... .......... .......... 36% 82.9M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34050K .......... .......... .......... .......... .......... 36% 80.3M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34100K .......... .......... .......... .......... .......... 36% 112M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34150K .......... .......... .......... .......... .......... 36% 53.7M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34200K .......... .......... .......... .......... .......... 36% 105M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34250K .......... .......... .......... .......... .......... 36% 95.0M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34300K .......... .......... .......... .......... .......... 36% 68.9M 1s 2020-04-28T13:00:01.620 INFO:teuthology.orchestra.run.smithi176.stderr: 34350K .......... .......... .......... .......... .......... 37% 73.9M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34400K .......... .......... .......... .......... .......... 37% 127M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34450K .......... .......... .......... .......... .......... 37% 85.1M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34500K .......... .......... .......... .......... .......... 37% 73.9M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34550K .......... .......... .......... .......... .......... 37% 72.4M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34600K .......... .......... .......... .......... .......... 37% 75.4M 1s 2020-04-28T13:00:01.621 INFO:teuthology.orchestra.run.smithi176.stderr: 34650K .......... .......... .......... .......... .......... 37% 125M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34700K .......... .......... .......... .......... .......... 37% 77.4M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34750K .......... .......... .......... .......... .......... 37% 67.9M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34800K .......... .......... .......... .......... .......... 37% 85.6M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34850K .......... .......... .......... .......... .......... 37% 119M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34900K .......... .......... .......... .......... .......... 37% 79.4M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 34950K .......... .......... .......... .......... .......... 37% 70.7M 1s 2020-04-28T13:00:01.622 INFO:teuthology.orchestra.run.smithi176.stderr: 35000K .......... .......... .......... .......... .......... 37% 67.2M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35050K .......... .......... .......... .......... .......... 37% 94.6M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35100K .......... .......... .......... .......... .......... 37% 85.7M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35150K .......... .......... .......... .......... .......... 37% 85.9M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35200K .......... .......... .......... .......... .......... 37% 88.3M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35250K .......... .......... .......... .......... .......... 37% 65.6M 1s 2020-04-28T13:00:01.623 INFO:teuthology.orchestra.run.smithi176.stderr: 35300K .......... .......... .......... .......... .......... 38% 77.5M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35350K .......... .......... .......... .......... .......... 38% 79.2M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35400K .......... .......... .......... .......... .......... 38% 93.6M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35450K .......... .......... .......... .......... .......... 38% 94.3M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35500K .......... .......... .......... .......... .......... 38% 71.1M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35550K .......... .......... .......... .......... .......... 38% 76.4M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35600K .......... .......... .......... .......... .......... 38% 113M 1s 2020-04-28T13:00:01.624 INFO:teuthology.orchestra.run.smithi176.stderr: 35650K .......... .......... .......... .......... .......... 38% 80.8M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35700K .......... .......... .......... .......... .......... 38% 84.6M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35750K .......... .......... .......... .......... .......... 38% 76.0M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35800K .......... .......... .......... .......... .......... 38% 62.0M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35850K .......... .......... .......... .......... .......... 38% 103M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35900K .......... .......... .......... .......... .......... 38% 114M 1s 2020-04-28T13:00:01.625 INFO:teuthology.orchestra.run.smithi176.stderr: 35950K .......... .......... .......... .......... .......... 38% 73.4M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36000K .......... .......... .......... .......... .......... 38% 100M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36050K .......... .......... .......... .......... .......... 38% 66.7M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36100K .......... .......... .......... .......... .......... 38% 120M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36150K .......... .......... .......... .......... .......... 38% 66.4M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36200K .......... .......... .......... .......... .......... 39% 69.3M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36250K .......... .......... .......... .......... .......... 39% 91.4M 1s 2020-04-28T13:00:01.626 INFO:teuthology.orchestra.run.smithi176.stderr: 36300K .......... .......... .......... .......... .......... 39% 85.9M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36350K .......... .......... .......... .......... .......... 39% 118M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36400K .......... .......... .......... .......... .......... 39% 74.3M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36450K .......... .......... .......... .......... .......... 39% 91.9M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36500K .......... .......... .......... .......... .......... 39% 69.5M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36550K .......... .......... .......... .......... .......... 39% 66.2M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36600K .......... .......... .......... .......... .......... 39% 120M 1s 2020-04-28T13:00:01.627 INFO:teuthology.orchestra.run.smithi176.stderr: 36650K .......... .......... .......... .......... .......... 39% 92.7M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36700K .......... .......... .......... .......... .......... 39% 68.3M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36750K .......... .......... .......... .......... .......... 39% 77.4M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36800K .......... .......... .......... .......... .......... 39% 87.5M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36850K .......... .......... .......... .......... .......... 39% 114M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36900K .......... .......... .......... .......... .......... 39% 77.2M 1s 2020-04-28T13:00:01.628 INFO:teuthology.orchestra.run.smithi176.stderr: 36950K .......... .......... .......... .......... .......... 39% 65.5M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37000K .......... .......... .......... .......... .......... 39% 81.5M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37050K .......... .......... .......... .......... .......... 39% 83.4M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37100K .......... .......... .......... .......... .......... 39% 114M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37150K .......... .......... .......... .......... .......... 40% 73.4M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37200K .......... .......... .......... .......... .......... 40% 87.2M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37250K .......... .......... .......... .......... .......... 40% 78.6M 1s 2020-04-28T13:00:01.629 INFO:teuthology.orchestra.run.smithi176.stderr: 37300K .......... .......... .......... .......... .......... 40% 115M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37350K .......... .......... .......... .......... .......... 40% 64.9M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37400K .......... .......... .......... .......... .......... 40% 82.6M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37450K .......... .......... .......... .......... .......... 40% 83.6M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37500K .......... .......... .......... .......... .......... 40% 81.8M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37550K .......... .......... .......... .......... .......... 40% 74.2M 1s 2020-04-28T13:00:01.630 INFO:teuthology.orchestra.run.smithi176.stderr: 37600K .......... .......... .......... .......... .......... 40% 107M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37650K .......... .......... .......... .......... .......... 40% 83.2M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37700K .......... .......... .......... .......... .......... 40% 74.8M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37750K .......... .......... .......... .......... .......... 40% 72.1M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37800K .......... .......... .......... .......... .......... 40% 76.6M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37850K .......... .......... .......... .......... .......... 40% 115M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37900K .......... .......... .......... .......... .......... 40% 89.2M 1s 2020-04-28T13:00:01.631 INFO:teuthology.orchestra.run.smithi176.stderr: 37950K .......... .......... .......... .......... .......... 40% 83.0M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38000K .......... .......... .......... .......... .......... 40% 81.0M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38050K .......... .......... .......... .......... .......... 41% 114M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38100K .......... .......... .......... .......... .......... 41% 84.0M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38150K .......... .......... .......... .......... .......... 41% 70.9M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38200K .......... .......... .......... .......... .......... 41% 102M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38250K .......... .......... .......... .......... .......... 41% 88.3M 1s 2020-04-28T13:00:01.632 INFO:teuthology.orchestra.run.smithi176.stderr: 38300K .......... .......... .......... .......... .......... 41% 114M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38350K .......... .......... .......... .......... .......... 41% 69.5M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38400K .......... .......... .......... .......... .......... 41% 97.2M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38450K .......... .......... .......... .......... .......... 41% 92.9M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38500K .......... .......... .......... .......... .......... 41% 73.8M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38550K .......... .......... .......... .......... .......... 41% 72.6M 1s 2020-04-28T13:00:01.633 INFO:teuthology.orchestra.run.smithi176.stderr: 38600K .......... .......... .......... .......... .......... 41% 112M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38650K .......... .......... .......... .......... .......... 41% 90.4M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38700K .......... .......... .......... .......... .......... 41% 80.8M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38750K .......... .......... .......... .......... .......... 41% 104M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38800K .......... .......... .......... .......... .......... 41% 93.3M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38850K .......... .......... .......... .......... .......... 41% 89.9M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38900K .......... .......... .......... .......... .......... 41% 97.1M 1s 2020-04-28T13:00:01.634 INFO:teuthology.orchestra.run.smithi176.stderr: 38950K .......... .......... .......... .......... .......... 41% 60.2M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39000K .......... .......... .......... .......... .......... 42% 82.4M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39050K .......... .......... .......... .......... .......... 42% 103M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39100K .......... .......... .......... .......... .......... 42% 110M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39150K .......... .......... .......... .......... .......... 42% 67.7M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39200K .......... .......... .......... .......... .......... 42% 86.1M 1s 2020-04-28T13:00:01.635 INFO:teuthology.orchestra.run.smithi176.stderr: 39250K .......... .......... .......... .......... .......... 42% 77.3M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39300K .......... .......... .......... .......... .......... 42% 121M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39350K .......... .......... .......... .......... .......... 42% 62.5M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39400K .......... .......... .......... .......... .......... 42% 88.5M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39450K .......... .......... .......... .......... .......... 42% 77.1M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39500K .......... .......... .......... .......... .......... 42% 77.1M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39550K .......... .......... .......... .......... .......... 42% 113M 1s 2020-04-28T13:00:01.636 INFO:teuthology.orchestra.run.smithi176.stderr: 39600K .......... .......... .......... .......... .......... 42% 80.0M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39650K .......... .......... .......... .......... .......... 42% 98.1M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39700K .......... .......... .......... .......... .......... 42% 75.4M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39750K .......... .......... .......... .......... .......... 42% 59.6M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39800K .......... .......... .......... .......... .......... 42% 118M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39850K .......... .......... .......... .......... .......... 42% 70.7M 1s 2020-04-28T13:00:01.637 INFO:teuthology.orchestra.run.smithi176.stderr: 39900K .......... .......... .......... .......... .......... 43% 67.5M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 39950K .......... .......... .......... .......... .......... 43% 63.5M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40000K .......... .......... .......... .......... .......... 43% 133M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40050K .......... .......... .......... .......... .......... 43% 71.4M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40100K .......... .......... .......... .......... .......... 43% 81.3M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40150K .......... .......... .......... .......... .......... 43% 54.5M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40200K .......... .......... .......... .......... .......... 43% 73.1M 1s 2020-04-28T13:00:01.638 INFO:teuthology.orchestra.run.smithi176.stderr: 40250K .......... .......... .......... .......... .......... 43% 70.8M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40300K .......... .......... .......... .......... .......... 43% 117M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40350K .......... .......... .......... .......... .......... 43% 70.6M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40400K .......... .......... .......... .......... .......... 43% 70.6M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40450K .......... .......... .......... .......... .......... 43% 78.2M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40500K .......... .......... .......... .......... .......... 43% 123M 1s 2020-04-28T13:00:01.639 INFO:teuthology.orchestra.run.smithi176.stderr: 40550K .......... .......... .......... .......... .......... 43% 52.5M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40600K .......... .......... .......... .......... .......... 43% 79.0M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40650K .......... .......... .......... .......... .......... 43% 75.5M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40700K .......... .......... .......... .......... .......... 43% 72.3M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40750K .......... .......... .......... .......... .......... 43% 108M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40800K .......... .......... .......... .......... .......... 43% 67.7M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40850K .......... .......... .......... .......... .......... 44% 70.9M 1s 2020-04-28T13:00:01.640 INFO:teuthology.orchestra.run.smithi176.stderr: 40900K .......... .......... .......... .......... .......... 44% 78.6M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 40950K .......... .......... .......... .......... .......... 44% 71.3M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41000K .......... .......... .......... .......... .......... 44% 87.0M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41050K .......... .......... .......... .......... .......... 44% 115M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41100K .......... .......... .......... .......... .......... 44% 75.8M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41150K .......... .......... .......... .......... .......... 44% 81.2M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41200K .......... .......... .......... .......... .......... 44% 73.0M 1s 2020-04-28T13:00:01.641 INFO:teuthology.orchestra.run.smithi176.stderr: 41250K .......... .......... .......... .......... .......... 44% 119M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41300K .......... .......... .......... .......... .......... 44% 88.1M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41350K .......... .......... .......... .......... .......... 44% 60.1M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41400K .......... .......... .......... .......... .......... 44% 80.7M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41450K .......... .......... .......... .......... .......... 44% 79.4M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41500K .......... .......... .......... .......... .......... 44% 118M 1s 2020-04-28T13:00:01.642 INFO:teuthology.orchestra.run.smithi176.stderr: 41550K .......... .......... .......... .......... .......... 44% 76.3M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41600K .......... .......... .......... .......... .......... 44% 78.5M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41650K .......... .......... .......... .......... .......... 44% 79.6M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41700K .......... .......... .......... .......... .......... 44% 119M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41750K .......... .......... .......... .......... .......... 44% 52.4M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41800K .......... .......... .......... .......... .......... 45% 122M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41850K .......... .......... .......... .......... .......... 45% 80.3M 1s 2020-04-28T13:00:01.643 INFO:teuthology.orchestra.run.smithi176.stderr: 41900K .......... .......... .......... .......... .......... 45% 78.3M 1s 2020-04-28T13:00:01.645 INFO:teuthology.orchestra.run.smithi176.stderr: 41950K .......... .......... .......... .......... .......... 45% 82.2M 1s 2020-04-28T13:00:01.645 INFO:teuthology.orchestra.run.smithi176.stderr: 42000K .......... .......... .......... .......... .......... 45% 118M 1s 2020-04-28T13:00:01.645 INFO:teuthology.orchestra.run.smithi176.stderr: 42050K .......... .......... .......... .......... .......... 45% 81.6M 1s 2020-04-28T13:00:01.645 INFO:teuthology.orchestra.run.smithi176.stderr: 42100K .......... .......... .......... .......... .......... 45% 88.8M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42150K .......... .......... .......... .......... .......... 45% 64.3M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42200K .......... .......... .......... .......... .......... 45% 70.9M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42250K .......... .......... .......... .......... .......... 45% 117M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42300K .......... .......... .......... .......... .......... 45% 83.3M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42350K .......... .......... .......... .......... .......... 45% 85.3M 1s 2020-04-28T13:00:01.646 INFO:teuthology.orchestra.run.smithi176.stderr: 42400K .......... .......... .......... .......... .......... 45% 81.3M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42450K .......... .......... .......... .......... .......... 45% 122M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42500K .......... .......... .......... .......... .......... 45% 71.6M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42550K .......... .......... .......... .......... .......... 45% 65.4M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42600K .......... .......... .......... .......... .......... 45% 99.9M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42650K .......... .......... .......... .......... .......... 45% 69.3M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42700K .......... .......... .......... .......... .......... 46% 88.3M 1s 2020-04-28T13:00:01.647 INFO:teuthology.orchestra.run.smithi176.stderr: 42750K .......... .......... .......... .......... .......... 46% 86.2M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 42800K .......... .......... .......... .......... .......... 46% 93.5M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 42850K .......... .......... .......... .......... .......... 46% 68.3M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 42900K .......... .......... .......... .......... .......... 46% 95.2M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 42950K .......... .......... .......... .......... .......... 46% 74.8M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 43000K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T13:00:01.648 INFO:teuthology.orchestra.run.smithi176.stderr: 43050K .......... .......... .......... .......... .......... 46% 66.9M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43100K .......... .......... .......... .......... .......... 46% 76.4M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43150K .......... .......... .......... .......... .......... 46% 87.2M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43200K .......... .......... .......... .......... .......... 46% 119M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43250K .......... .......... .......... .......... .......... 46% 68.1M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43300K .......... .......... .......... .......... .......... 46% 76.2M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43350K .......... .......... .......... .......... .......... 46% 71.5M 1s 2020-04-28T13:00:01.649 INFO:teuthology.orchestra.run.smithi176.stderr: 43400K .......... .......... .......... .......... .......... 46% 87.8M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43450K .......... .......... .......... .......... .......... 46% 85.8M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43500K .......... .......... .......... .......... .......... 46% 90.9M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43550K .......... .......... .......... .......... .......... 46% 87.2M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43600K .......... .......... .......... .......... .......... 46% 84.6M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43650K .......... .......... .......... .......... .......... 47% 67.6M 1s 2020-04-28T13:00:01.650 INFO:teuthology.orchestra.run.smithi176.stderr: 43700K .......... .......... .......... .......... .......... 47% 123M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 43750K .......... .......... .......... .......... .......... 47% 62.1M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 43800K .......... .......... .......... .......... .......... 47% 88.8M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 43850K .......... .......... .......... .......... .......... 47% 74.5M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 43900K .......... .......... .......... .......... .......... 47% 77.4M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 43950K .......... .......... .......... .......... .......... 47% 107M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 44000K .......... .......... .......... .......... .......... 47% 77.0M 1s 2020-04-28T13:00:01.651 INFO:teuthology.orchestra.run.smithi176.stderr: 44050K .......... .......... .......... .......... .......... 47% 89.7M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44100K .......... .......... .......... .......... .......... 47% 79.7M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44150K .......... .......... .......... .......... .......... 47% 63.6M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44200K .......... .......... .......... .......... .......... 47% 116M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44250K .......... .......... .......... .......... .......... 47% 85.8M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44300K .......... .......... .......... .......... .......... 47% 91.2M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44350K .......... .......... .......... .......... .......... 47% 69.8M 1s 2020-04-28T13:00:01.652 INFO:teuthology.orchestra.run.smithi176.stderr: 44400K .......... .......... .......... .......... .......... 47% 91.5M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44450K .......... .......... .......... .......... .......... 47% 120M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44500K .......... .......... .......... .......... .......... 47% 70.8M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44550K .......... .......... .......... .......... .......... 48% 71.4M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44600K .......... .......... .......... .......... .......... 48% 72.6M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44650K .......... .......... .......... .......... .......... 48% 87.3M 1s 2020-04-28T13:00:01.653 INFO:teuthology.orchestra.run.smithi176.stderr: 44700K .......... .......... .......... .......... .......... 48% 120M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 44750K .......... .......... .......... .......... .......... 48% 70.8M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 44800K .......... .......... .......... .......... .......... 48% 88.0M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 44850K .......... .......... .......... .......... .......... 48% 72.0M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 44900K .......... .......... .......... .......... .......... 48% 119M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 44950K .......... .......... .......... .......... .......... 48% 63.2M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 45000K .......... .......... .......... .......... .......... 48% 88.6M 1s 2020-04-28T13:00:01.654 INFO:teuthology.orchestra.run.smithi176.stderr: 45050K .......... .......... .......... .......... .......... 48% 73.0M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45100K .......... .......... .......... .......... .......... 48% 74.7M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45150K .......... .......... .......... .......... .......... 48% 83.5M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45200K .......... .......... .......... .......... .......... 48% 105M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45250K .......... .......... .......... .......... .......... 48% 81.1M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45300K .......... .......... .......... .......... .......... 48% 85.3M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45350K .......... .......... .......... .......... .......... 48% 66.6M 1s 2020-04-28T13:00:01.655 INFO:teuthology.orchestra.run.smithi176.stderr: 45400K .......... .......... .......... .......... .......... 48% 67.8M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45450K .......... .......... .......... .......... .......... 48% 108M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45500K .......... .......... .......... .......... .......... 49% 92.7M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45550K .......... .......... .......... .......... .......... 49% 70.2M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45600K .......... .......... .......... .......... .......... 49% 89.2M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45650K .......... .......... .......... .......... .......... 49% 120M 1s 2020-04-28T13:00:01.656 INFO:teuthology.orchestra.run.smithi176.stderr: 45700K .......... .......... .......... .......... .......... 49% 67.7M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 45750K .......... .......... .......... .......... .......... 49% 69.6M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 45800K .......... .......... .......... .......... .......... 49% 80.6M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 45850K .......... .......... .......... .......... .......... 49% 81.1M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 45900K .......... .......... .......... .......... .......... 49% 107M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 45950K .......... .......... .......... .......... .......... 49% 77.8M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 46000K .......... .......... .......... .......... .......... 49% 80.1M 1s 2020-04-28T13:00:01.657 INFO:teuthology.orchestra.run.smithi176.stderr: 46050K .......... .......... .......... .......... .......... 49% 87.6M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46100K .......... .......... .......... .......... .......... 49% 75.8M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46150K .......... .......... .......... .......... .......... 49% 68.9M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46200K .......... .......... .......... .......... .......... 49% 111M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46250K .......... .......... .......... .......... .......... 49% 81.7M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46300K .......... .......... .......... .......... .......... 49% 81.5M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46350K .......... .......... .......... .......... .......... 49% 78.2M 1s 2020-04-28T13:00:01.658 INFO:teuthology.orchestra.run.smithi176.stderr: 46400K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46450K .......... .......... .......... .......... .......... 50% 76.9M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46500K .......... .......... .......... .......... .......... 50% 77.7M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46550K .......... .......... .......... .......... .......... 50% 65.7M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46600K .......... .......... .......... .......... .......... 50% 79.1M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46650K .......... .......... .......... .......... .......... 50% 115M 1s 2020-04-28T13:00:01.659 INFO:teuthology.orchestra.run.smithi176.stderr: 46700K .......... .......... .......... .......... .......... 50% 85.9M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 46750K .......... .......... .......... .......... .......... 50% 75.2M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 46800K .......... .......... .......... .......... .......... 50% 88.1M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 46850K .......... .......... .......... .......... .......... 50% 70.0M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 46900K .......... .......... .......... .......... .......... 50% 127M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 46950K .......... .......... .......... .......... .......... 50% 68.9M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 47000K .......... .......... .......... .......... .......... 50% 84.9M 1s 2020-04-28T13:00:01.660 INFO:teuthology.orchestra.run.smithi176.stderr: 47050K .......... .......... .......... .......... .......... 50% 73.8M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47100K .......... .......... .......... .......... .......... 50% 74.8M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47150K .......... .......... .......... .......... .......... 50% 112M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47200K .......... .......... .......... .......... .......... 50% 81.5M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47250K .......... .......... .......... .......... .......... 50% 73.7M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47300K .......... .......... .......... .......... .......... 50% 84.5M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47350K .......... .......... .......... .......... .......... 51% 61.5M 1s 2020-04-28T13:00:01.661 INFO:teuthology.orchestra.run.smithi176.stderr: 47400K .......... .......... .......... .......... .......... 51% 123M 1s 2020-04-28T13:00:01.662 INFO:teuthology.orchestra.run.smithi176.stderr: 47450K .......... .......... .......... .......... .......... 51% 78.5M 1s 2020-04-28T13:00:01.662 INFO:teuthology.orchestra.run.smithi176.stderr: 47500K .......... .......... .......... .......... .......... 51% 78.6M 1s 2020-04-28T13:00:01.662 INFO:teuthology.orchestra.run.smithi176.stderr: 47550K .......... .......... .......... .......... .......... 51% 82.2M 1s 2020-04-28T13:00:01.662 INFO:teuthology.orchestra.run.smithi176.stderr: 47600K .......... .......... .......... .......... .......... 51% 96.1M 1s 2020-04-28T13:00:01.662 INFO:teuthology.orchestra.run.smithi176.stderr: 47650K .......... .......... .......... .......... .......... 51% 85.0M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47700K .......... .......... .......... .......... .......... 51% 77.4M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47750K .......... .......... .......... .......... .......... 51% 69.3M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47800K .......... .......... .......... .......... .......... 51% 80.8M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47850K .......... .......... .......... .......... .......... 51% 78.2M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47900K .......... .......... .......... .......... .......... 51% 114M 1s 2020-04-28T13:00:01.663 INFO:teuthology.orchestra.run.smithi176.stderr: 47950K .......... .......... .......... .......... .......... 51% 69.1M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48000K .......... .......... .......... .......... .......... 51% 91.6M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48050K .......... .......... .......... .......... .......... 51% 90.0M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48100K .......... .......... .......... .......... .......... 51% 91.8M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48150K .......... .......... .......... .......... .......... 51% 69.2M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48200K .......... .......... .......... .......... .......... 51% 55.4M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48250K .......... .......... .......... .......... .......... 51% 135M 1s 2020-04-28T13:00:01.664 INFO:teuthology.orchestra.run.smithi176.stderr: 48300K .......... .......... .......... .......... .......... 52% 82.4M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48350K .......... .......... .......... .......... .......... 52% 118M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48400K .......... .......... .......... .......... .......... 52% 90.6M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48450K .......... .......... .......... .......... .......... 52% 71.4M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48500K .......... .......... .......... .......... .......... 52% 83.4M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48550K .......... .......... .......... .......... .......... 52% 60.2M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48600K .......... .......... .......... .......... .......... 52% 94.8M 1s 2020-04-28T13:00:01.665 INFO:teuthology.orchestra.run.smithi176.stderr: 48650K .......... .......... .......... .......... .......... 52% 117M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48700K .......... .......... .......... .......... .......... 52% 65.3M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48750K .......... .......... .......... .......... .......... 52% 84.5M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48800K .......... .......... .......... .......... .......... 52% 82.1M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48850K .......... .......... .......... .......... .......... 52% 130M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48900K .......... .......... .......... .......... .......... 52% 69.2M 1s 2020-04-28T13:00:01.666 INFO:teuthology.orchestra.run.smithi176.stderr: 48950K .......... .......... .......... .......... .......... 52% 67.4M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49000K .......... .......... .......... .......... .......... 52% 86.5M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49050K .......... .......... .......... .......... .......... 52% 72.5M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49100K .......... .......... .......... .......... .......... 52% 118M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49150K .......... .......... .......... .......... .......... 52% 62.0M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49200K .......... .......... .......... .......... .......... 53% 92.5M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49250K .......... .......... .......... .......... .......... 53% 89.7M 1s 2020-04-28T13:00:01.667 INFO:teuthology.orchestra.run.smithi176.stderr: 49300K .......... .......... .......... .......... .......... 53% 116M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49350K .......... .......... .......... .......... .......... 53% 52.2M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49400K .......... .......... .......... .......... .......... 53% 96.0M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49450K .......... .......... .......... .......... .......... 53% 78.0M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49500K .......... .......... .......... .......... .......... 53% 92.2M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49550K .......... .......... .......... .......... .......... 53% 68.6M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49600K .......... .......... .......... .......... .......... 53% 120M 1s 2020-04-28T13:00:01.668 INFO:teuthology.orchestra.run.smithi176.stderr: 49650K .......... .......... .......... .......... .......... 53% 85.2M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49700K .......... .......... .......... .......... .......... 53% 82.0M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49750K .......... .......... .......... .......... .......... 53% 54.5M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49800K .......... .......... .......... .......... .......... 53% 106M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49850K .......... .......... .......... .......... .......... 53% 117M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49900K .......... .......... .......... .......... .......... 53% 71.4M 1s 2020-04-28T13:00:01.669 INFO:teuthology.orchestra.run.smithi176.stderr: 49950K .......... .......... .......... .......... .......... 53% 83.3M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50000K .......... .......... .......... .......... .......... 53% 76.6M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50050K .......... .......... .......... .......... .......... 53% 124M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50100K .......... .......... .......... .......... .......... 53% 68.7M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50150K .......... .......... .......... .......... .......... 54% 60.6M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50200K .......... .......... .......... .......... .......... 54% 84.5M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50250K .......... .......... .......... .......... .......... 54% 78.5M 1s 2020-04-28T13:00:01.670 INFO:teuthology.orchestra.run.smithi176.stderr: 50300K .......... .......... .......... .......... .......... 54% 79.0M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50350K .......... .......... .......... .......... .......... 54% 103M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50400K .......... .......... .......... .......... .......... 54% 78.5M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50450K .......... .......... .......... .......... .......... 54% 76.4M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50500K .......... .......... .......... .......... .......... 54% 85.1M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50550K .......... .......... .......... .......... .......... 54% 62.8M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50600K .......... .......... .......... .......... .......... 54% 109M 1s 2020-04-28T13:00:01.671 INFO:teuthology.orchestra.run.smithi176.stderr: 50650K .......... .......... .......... .......... .......... 54% 96.8M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50700K .......... .......... .......... .......... .......... 54% 72.1M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50750K .......... .......... .......... .......... .......... 54% 85.6M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50800K .......... .......... .......... .......... .......... 54% 114M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50850K .......... .......... .......... .......... .......... 54% 76.5M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50900K .......... .......... .......... .......... .......... 54% 81.8M 1s 2020-04-28T13:00:01.672 INFO:teuthology.orchestra.run.smithi176.stderr: 50950K .......... .......... .......... .......... .......... 54% 63.0M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51000K .......... .......... .......... .......... .......... 54% 78.0M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51050K .......... .......... .......... .......... .......... 55% 84.2M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51100K .......... .......... .......... .......... .......... 55% 121M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51150K .......... .......... .......... .......... .......... 55% 72.7M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51200K .......... .......... .......... .......... .......... 55% 80.1M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51250K .......... .......... .......... .......... .......... 55% 74.7M 1s 2020-04-28T13:00:01.673 INFO:teuthology.orchestra.run.smithi176.stderr: 51300K .......... .......... .......... .......... .......... 55% 130M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51350K .......... .......... .......... .......... .......... 55% 71.1M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51400K .......... .......... .......... .......... .......... 55% 77.1M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51450K .......... .......... .......... .......... .......... 55% 71.1M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51500K .......... .......... .......... .......... .......... 55% 70.6M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51550K .......... .......... .......... .......... .......... 55% 113M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51600K .......... .......... .......... .......... .......... 55% 94.2M 1s 2020-04-28T13:00:01.674 INFO:teuthology.orchestra.run.smithi176.stderr: 51650K .......... .......... .......... .......... .......... 55% 86.3M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51700K .......... .......... .......... .......... .......... 55% 68.1M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51750K .......... .......... .......... .......... .......... 55% 63.2M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51800K .......... .......... .......... .......... .......... 55% 119M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51850K .......... .......... .......... .......... .......... 55% 68.1M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51900K .......... .......... .......... .......... .......... 55% 75.6M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 51950K .......... .......... .......... .......... .......... 55% 71.4M 1s 2020-04-28T13:00:01.675 INFO:teuthology.orchestra.run.smithi176.stderr: 52000K .......... .......... .......... .......... .......... 56% 75.5M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52050K .......... .......... .......... .......... .......... 56% 115M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52100K .......... .......... .......... .......... .......... 56% 63.7M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52150K .......... .......... .......... .......... .......... 56% 70.1M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52200K .......... .......... .......... .......... .......... 56% 65.7M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52250K .......... .......... .......... .......... .......... 56% 74.8M 1s 2020-04-28T13:00:01.676 INFO:teuthology.orchestra.run.smithi176.stderr: 52300K .......... .......... .......... .......... .......... 56% 109M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52350K .......... .......... .......... .......... .......... 56% 75.3M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52400K .......... .......... .......... .......... .......... 56% 70.5M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52450K .......... .......... .......... .......... .......... 56% 61.3M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52500K .......... .......... .......... .......... .......... 56% 155M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52550K .......... .......... .......... .......... .......... 56% 60.6M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52600K .......... .......... .......... .......... .......... 56% 75.1M 1s 2020-04-28T13:00:01.677 INFO:teuthology.orchestra.run.smithi176.stderr: 52650K .......... .......... .......... .......... .......... 56% 66.3M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52700K .......... .......... .......... .......... .......... 56% 77.0M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52750K .......... .......... .......... .......... .......... 56% 91.3M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52800K .......... .......... .......... .......... .......... 56% 90.2M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52850K .......... .......... .......... .......... .......... 56% 79.6M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52900K .......... .......... .......... .......... .......... 56% 62.8M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 52950K .......... .......... .......... .......... .......... 57% 69.1M 1s 2020-04-28T13:00:01.678 INFO:teuthology.orchestra.run.smithi176.stderr: 53000K .......... .......... .......... .......... .......... 57% 75.8M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53050K .......... .......... .......... .......... .......... 57% 106M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53100K .......... .......... .......... .......... .......... 57% 98.8M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53150K .......... .......... .......... .......... .......... 57% 71.3M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53200K .......... .......... .......... .......... .......... 57% 79.7M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53250K .......... .......... .......... .......... .......... 57% 114M 1s 2020-04-28T13:00:01.679 INFO:teuthology.orchestra.run.smithi176.stderr: 53300K .......... .......... .......... .......... .......... 57% 77.2M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53350K .......... .......... .......... .......... .......... 57% 69.4M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53400K .......... .......... .......... .......... .......... 57% 74.6M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53450K .......... .......... .......... .......... .......... 57% 86.1M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53500K .......... .......... .......... .......... .......... 57% 117M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53550K .......... .......... .......... .......... .......... 57% 75.3M 1s 2020-04-28T13:00:01.680 INFO:teuthology.orchestra.run.smithi176.stderr: 53600K .......... .......... .......... .......... .......... 57% 86.6M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53650K .......... .......... .......... .......... .......... 57% 90.6M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53700K .......... .......... .......... .......... .......... 57% 67.5M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53750K .......... .......... .......... .......... .......... 57% 62.8M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53800K .......... .......... .......... .......... .......... 57% 115M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53850K .......... .......... .......... .......... .......... 58% 81.7M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53900K .......... .......... .......... .......... .......... 58% 77.7M 1s 2020-04-28T13:00:01.681 INFO:teuthology.orchestra.run.smithi176.stderr: 53950K .......... .......... .......... .......... .......... 58% 84.0M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54000K .......... .......... .......... .......... .......... 58% 105M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54050K .......... .......... .......... .......... .......... 58% 84.3M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54100K .......... .......... .......... .......... .......... 58% 74.9M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54150K .......... .......... .......... .......... .......... 58% 70.8M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54200K .......... .......... .......... .......... .......... 58% 80.9M 1s 2020-04-28T13:00:01.682 INFO:teuthology.orchestra.run.smithi176.stderr: 54250K .......... .......... .......... .......... .......... 58% 92.6M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54300K .......... .......... .......... .......... .......... 58% 83.2M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54350K .......... .......... .......... .......... .......... 58% 82.2M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54400K .......... .......... .......... .......... .......... 58% 77.7M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54450K .......... .......... .......... .......... .......... 58% 88.3M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54500K .......... .......... .......... .......... .......... 58% 108M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54550K .......... .......... .......... .......... .......... 58% 70.0M 1s 2020-04-28T13:00:01.683 INFO:teuthology.orchestra.run.smithi176.stderr: 54600K .......... .......... .......... .......... .......... 58% 78.8M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54650K .......... .......... .......... .......... .......... 58% 80.1M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54700K .......... .......... .......... .......... .......... 58% 80.5M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54750K .......... .......... .......... .......... .......... 58% 110M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54800K .......... .......... .......... .......... .......... 59% 80.9M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54850K .......... .......... .......... .......... .......... 59% 80.8M 1s 2020-04-28T13:00:01.684 INFO:teuthology.orchestra.run.smithi176.stderr: 54900K .......... .......... .......... .......... .......... 59% 76.2M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 54950K .......... .......... .......... .......... .......... 59% 68.0M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55000K .......... .......... .......... .......... .......... 59% 114M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55050K .......... .......... .......... .......... .......... 59% 81.6M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55100K .......... .......... .......... .......... .......... 59% 83.2M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55150K .......... .......... .......... .......... .......... 59% 92.2M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55200K .......... .......... .......... .......... .......... 59% 119M 1s 2020-04-28T13:00:01.685 INFO:teuthology.orchestra.run.smithi176.stderr: 55250K .......... .......... .......... .......... .......... 59% 78.3M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55300K .......... .......... .......... .......... .......... 59% 75.3M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55350K .......... .......... .......... .......... .......... 59% 67.4M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55400K .......... .......... .......... .......... .......... 59% 73.6M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55450K .......... .......... .......... .......... .......... 59% 94.9M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55500K .......... .......... .......... .......... .......... 59% 108M 1s 2020-04-28T13:00:01.686 INFO:teuthology.orchestra.run.smithi176.stderr: 55550K .......... .......... .......... .......... .......... 59% 76.9M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55600K .......... .......... .......... .......... .......... 59% 74.0M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55650K .......... .......... .......... .......... .......... 59% 100M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55700K .......... .......... .......... .......... .......... 60% 117M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55750K .......... .......... .......... .......... .......... 60% 63.5M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55800K .......... .......... .......... .......... .......... 60% 69.5M 1s 2020-04-28T13:00:01.687 INFO:teuthology.orchestra.run.smithi176.stderr: 55850K .......... .......... .......... .......... .......... 60% 65.5M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 55900K .......... .......... .......... .......... .......... 60% 141M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 55950K .......... .......... .......... .......... .......... 60% 112M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 56000K .......... .......... .......... .......... .......... 60% 66.5M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 56050K .......... .......... .......... .......... .......... 60% 81.6M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 56100K .......... .......... .......... .......... .......... 60% 72.9M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 56150K .......... .......... .......... .......... .......... 60% 78.0M 1s 2020-04-28T13:00:01.688 INFO:teuthology.orchestra.run.smithi176.stderr: 56200K .......... .......... .......... .......... .......... 60% 53.7M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56250K .......... .......... .......... .......... .......... 60% 40.8M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56300K .......... .......... .......... .......... .......... 60% 200M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56350K .......... .......... .......... .......... .......... 60% 190M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56400K .......... .......... .......... .......... .......... 60% 176M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56450K .......... .......... .......... .......... .......... 60% 120M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56500K .......... .......... .......... .......... .......... 60% 90.3M 1s 2020-04-28T13:00:01.689 INFO:teuthology.orchestra.run.smithi176.stderr: 56550K .......... .......... .......... .......... .......... 60% 57.6M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56600K .......... .......... .......... .......... .......... 60% 77.2M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56650K .......... .......... .......... .......... .......... 61% 73.2M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56700K .......... .......... .......... .......... .......... 61% 124M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56750K .......... .......... .......... .......... .......... 61% 82.0M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56800K .......... .......... .......... .......... .......... 61% 81.1M 1s 2020-04-28T13:00:01.690 INFO:teuthology.orchestra.run.smithi176.stderr: 56850K .......... .......... .......... .......... .......... 61% 73.0M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 56900K .......... .......... .......... .......... .......... 61% 118M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 56950K .......... .......... .......... .......... .......... 61% 55.3M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 57000K .......... .......... .......... .......... .......... 61% 116M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 57050K .......... .......... .......... .......... .......... 61% 72.6M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 57100K .......... .......... .......... .......... .......... 61% 90.9M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 57150K .......... .......... .......... .......... .......... 61% 68.7M 1s 2020-04-28T13:00:01.691 INFO:teuthology.orchestra.run.smithi176.stderr: 57200K .......... .......... .......... .......... .......... 61% 118M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57250K .......... .......... .......... .......... .......... 61% 84.3M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57300K .......... .......... .......... .......... .......... 61% 77.0M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57350K .......... .......... .......... .......... .......... 61% 72.4M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57400K .......... .......... .......... .......... .......... 61% 85.5M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57450K .......... .......... .......... .......... .......... 61% 114M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57500K .......... .......... .......... .......... .......... 61% 64.1M 1s 2020-04-28T13:00:01.692 INFO:teuthology.orchestra.run.smithi176.stderr: 57550K .......... .......... .......... .......... .......... 62% 89.2M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57600K .......... .......... .......... .......... .......... 62% 89.9M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57650K .......... .......... .......... .......... .......... 62% 120M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57700K .......... .......... .......... .......... .......... 62% 65.4M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57750K .......... .......... .......... .......... .......... 62% 63.3M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57800K .......... .......... .......... .......... .......... 62% 82.7M 1s 2020-04-28T13:00:01.693 INFO:teuthology.orchestra.run.smithi176.stderr: 57850K .......... .......... .......... .......... .......... 62% 81.7M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 57900K .......... .......... .......... .......... .......... 62% 89.0M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 57950K .......... .......... .......... .......... .......... 62% 94.0M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 58000K .......... .......... .......... .......... .......... 62% 81.3M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 58050K .......... .......... .......... .......... .......... 62% 95.4M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 58100K .......... .......... .......... .......... .......... 62% 74.2M 1s 2020-04-28T13:00:01.694 INFO:teuthology.orchestra.run.smithi176.stderr: 58150K .......... .......... .......... .......... .......... 62% 73.2M 1s 2020-04-28T13:00:01.695 INFO:teuthology.orchestra.run.smithi176.stderr: 58200K .......... .......... .......... .......... .......... 62% 108M 1s 2020-04-28T13:00:01.695 INFO:teuthology.orchestra.run.smithi176.stderr: 58250K .......... .......... .......... .......... .......... 62% 84.7M 1s 2020-04-28T13:00:01.695 INFO:teuthology.orchestra.run.smithi176.stderr: 58300K .......... .......... .......... .......... .......... 62% 85.6M 1s 2020-04-28T13:00:01.695 INFO:teuthology.orchestra.run.smithi176.stderr: 58350K .......... .......... .......... .......... .......... 62% 63.2M 1s 2020-04-28T13:00:01.695 INFO:teuthology.orchestra.run.smithi176.stderr: 58400K .......... .......... .......... .......... .......... 62% 115M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58450K .......... .......... .......... .......... .......... 62% 100M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58500K .......... .......... .......... .......... .......... 63% 67.7M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58550K .......... .......... .......... .......... .......... 63% 61.5M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58600K .......... .......... .......... .......... .......... 63% 92.4M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58650K .......... .......... .......... .......... .......... 63% 79.5M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58700K .......... .......... .......... .......... .......... 63% 111M 1s 2020-04-28T13:00:01.696 INFO:teuthology.orchestra.run.smithi176.stderr: 58750K .......... .......... .......... .......... .......... 63% 80.1M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 58800K .......... .......... .......... .......... .......... 63% 81.7M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 58850K .......... .......... .......... .......... .......... 63% 73.0M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 58900K .......... .......... .......... .......... .......... 63% 108M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 58950K .......... .......... .......... .......... .......... 63% 72.8M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 59000K .......... .......... .......... .......... .......... 63% 77.2M 1s 2020-04-28T13:00:01.697 INFO:teuthology.orchestra.run.smithi176.stderr: 59050K .......... .......... .......... .......... .......... 63% 80.8M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59100K .......... .......... .......... .......... .......... 63% 71.6M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59150K .......... .......... .......... .......... .......... 63% 119M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59200K .......... .......... .......... .......... .......... 63% 92.6M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59250K .......... .......... .......... .......... .......... 63% 51.9M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59300K .......... .......... .......... .......... .......... 63% 87.8M 1s 2020-04-28T13:00:01.698 INFO:teuthology.orchestra.run.smithi176.stderr: 59350K .......... .......... .......... .......... .......... 63% 67.4M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59400K .......... .......... .......... .......... .......... 63% 117M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59450K .......... .......... .......... .......... .......... 64% 98.5M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59500K .......... .......... .......... .......... .......... 64% 68.5M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59550K .......... .......... .......... .......... .......... 64% 84.3M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59600K .......... .......... .......... .......... .......... 64% 73.6M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59650K .......... .......... .......... .......... .......... 64% 119M 1s 2020-04-28T13:00:01.699 INFO:teuthology.orchestra.run.smithi176.stderr: 59700K .......... .......... .......... .......... .......... 64% 89.6M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 59750K .......... .......... .......... .......... .......... 64% 64.1M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 59800K .......... .......... .......... .......... .......... 64% 80.7M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 59850K .......... .......... .......... .......... .......... 64% 87.8M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 59900K .......... .......... .......... .......... .......... 64% 116M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 59950K .......... .......... .......... .......... .......... 64% 72.8M 1s 2020-04-28T13:00:01.700 INFO:teuthology.orchestra.run.smithi176.stderr: 60000K .......... .......... .......... .......... .......... 64% 69.5M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60050K .......... .......... .......... .......... .......... 64% 92.2M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60100K .......... .......... .......... .......... .......... 64% 109M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60150K .......... .......... .......... .......... .......... 64% 68.4M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60200K .......... .......... .......... .......... .......... 64% 75.1M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60250K .......... .......... .......... .......... .......... 64% 93.8M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60300K .......... .......... .......... .......... .......... 64% 69.2M 1s 2020-04-28T13:00:01.701 INFO:teuthology.orchestra.run.smithi176.stderr: 60350K .......... .......... .......... .......... .......... 65% 79.1M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60400K .......... .......... .......... .......... .......... 65% 116M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60450K .......... .......... .......... .......... .......... 65% 81.1M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60500K .......... .......... .......... .......... .......... 65% 78.6M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60550K .......... .......... .......... .......... .......... 65% 74.5M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60600K .......... .......... .......... .......... .......... 65% 69.4M 1s 2020-04-28T13:00:01.702 INFO:teuthology.orchestra.run.smithi176.stderr: 60650K .......... .......... .......... .......... .......... 65% 118M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60700K .......... .......... .......... .......... .......... 65% 80.9M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60750K .......... .......... .......... .......... .......... 65% 73.3M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60800K .......... .......... .......... .......... .......... 65% 83.1M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60850K .......... .......... .......... .......... .......... 65% 130M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60900K .......... .......... .......... .......... .......... 65% 90.0M 1s 2020-04-28T13:00:01.703 INFO:teuthology.orchestra.run.smithi176.stderr: 60950K .......... .......... .......... .......... .......... 65% 56.5M 0s 2020-04-28T13:00:01.704 INFO:teuthology.orchestra.run.smithi176.stderr: 61000K .......... .......... .......... .......... .......... 65% 81.3M 0s 2020-04-28T13:00:01.704 INFO:teuthology.orchestra.run.smithi176.stderr: 61050K .......... .......... .......... .......... .......... 65% 80.2M 0s 2020-04-28T13:00:01.704 INFO:teuthology.orchestra.run.smithi176.stderr: 61100K .......... .......... .......... .......... .......... 65% 120M 0s 2020-04-28T13:00:01.704 INFO:teuthology.orchestra.run.smithi176.stderr: 61150K .......... .......... .......... .......... .......... 65% 76.1M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61200K .......... .......... .......... .......... .......... 65% 82.6M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61250K .......... .......... .......... .......... .......... 65% 70.7M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61300K .......... .......... .......... .......... .......... 66% 80.7M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61350K .......... .......... .......... .......... .......... 66% 76.8M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61400K .......... .......... .......... .......... .......... 66% 126M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61450K .......... .......... .......... .......... .......... 66% 70.4M 0s 2020-04-28T13:00:01.705 INFO:teuthology.orchestra.run.smithi176.stderr: 61500K .......... .......... .......... .......... .......... 66% 78.8M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61550K .......... .......... .......... .......... .......... 66% 73.3M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61600K .......... .......... .......... .......... .......... 66% 119M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61650K .......... .......... .......... .......... .......... 66% 85.3M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61700K .......... .......... .......... .......... .......... 66% 74.5M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61750K .......... .......... .......... .......... .......... 66% 64.4M 0s 2020-04-28T13:00:01.706 INFO:teuthology.orchestra.run.smithi176.stderr: 61800K .......... .......... .......... .......... .......... 66% 59.4M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 61850K .......... .......... .......... .......... .......... 66% 77.6M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 61900K .......... .......... .......... .......... .......... 66% 152M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 61950K .......... .......... .......... .......... .......... 66% 71.9M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 62000K .......... .......... .......... .......... .......... 66% 72.9M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 62050K .......... .......... .......... .......... .......... 66% 92.6M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 62100K .......... .......... .......... .......... .......... 66% 120M 0s 2020-04-28T13:00:01.707 INFO:teuthology.orchestra.run.smithi176.stderr: 62150K .......... .......... .......... .......... .......... 66% 65.3M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62200K .......... .......... .......... .......... .......... 67% 91.3M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62250K .......... .......... .......... .......... .......... 67% 62.4M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62300K .......... .......... .......... .......... .......... 67% 85.0M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62350K .......... .......... .......... .......... .......... 67% 102M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62400K .......... .......... .......... .......... .......... 67% 84.5M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62450K .......... .......... .......... .......... .......... 67% 85.1M 0s 2020-04-28T13:00:01.708 INFO:teuthology.orchestra.run.smithi176.stderr: 62500K .......... .......... .......... .......... .......... 67% 73.6M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62550K .......... .......... .......... .......... .......... 67% 64.0M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62600K .......... .......... .......... .......... .......... 67% 120M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62650K .......... .......... .......... .......... .......... 67% 77.1M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62700K .......... .......... .......... .......... .......... 67% 90.3M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62750K .......... .......... .......... .......... .......... 67% 61.4M 0s 2020-04-28T13:00:01.709 INFO:teuthology.orchestra.run.smithi176.stderr: 62800K .......... .......... .......... .......... .......... 67% 119M 0s 2020-04-28T13:00:01.710 INFO:teuthology.orchestra.run.smithi176.stderr: 62850K .......... .......... .......... .......... .......... 67% 89.6M 0s 2020-04-28T13:00:01.710 INFO:teuthology.orchestra.run.smithi176.stderr: 62900K .......... .......... .......... .......... .......... 67% 82.9M 0s 2020-04-28T13:00:01.710 INFO:teuthology.orchestra.run.smithi176.stderr: 62950K .......... .......... .......... .......... .......... 67% 62.5M 0s 2020-04-28T13:00:01.710 INFO:teuthology.orchestra.run.smithi176.stderr: 63000K .......... .......... .......... .......... .......... 67% 70.5M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63050K .......... .......... .......... .......... .......... 67% 95.1M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63100K .......... .......... .......... .......... .......... 67% 107M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63150K .......... .......... .......... .......... .......... 68% 70.7M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63200K .......... .......... .......... .......... .......... 68% 85.1M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63250K .......... .......... .......... .......... .......... 68% 80.9M 0s 2020-04-28T13:00:01.711 INFO:teuthology.orchestra.run.smithi176.stderr: 63300K .......... .......... .......... .......... .......... 68% 123M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63350K .......... .......... .......... .......... .......... 68% 62.7M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63400K .......... .......... .......... .......... .......... 68% 81.6M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63450K .......... .......... .......... .......... .......... 68% 75.5M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63500K .......... .......... .......... .......... .......... 68% 82.5M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63550K .......... .......... .......... .......... .......... 68% 106M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63600K .......... .......... .......... .......... .......... 68% 77.5M 0s 2020-04-28T13:00:01.712 INFO:teuthology.orchestra.run.smithi176.stderr: 63650K .......... .......... .......... .......... .......... 68% 84.6M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63700K .......... .......... .......... .......... .......... 68% 78.5M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63750K .......... .......... .......... .......... .......... 68% 53.9M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63800K .......... .......... .......... .......... .......... 68% 82.1M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63850K .......... .......... .......... .......... .......... 68% 120M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63900K .......... .......... .......... .......... .......... 68% 79.0M 0s 2020-04-28T13:00:01.713 INFO:teuthology.orchestra.run.smithi176.stderr: 63950K .......... .......... .......... .......... .......... 68% 64.1M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64000K .......... .......... .......... .......... .......... 68% 84.6M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64050K .......... .......... .......... .......... .......... 68% 119M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64100K .......... .......... .......... .......... .......... 69% 70.5M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64150K .......... .......... .......... .......... .......... 69% 63.9M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64200K .......... .......... .......... .......... .......... 69% 65.6M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64250K .......... .......... .......... .......... .......... 69% 64.6M 0s 2020-04-28T13:00:01.714 INFO:teuthology.orchestra.run.smithi176.stderr: 64300K .......... .......... .......... .......... .......... 69% 122M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64350K .......... .......... .......... .......... .......... 69% 56.8M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64400K .......... .......... .......... .......... .......... 69% 85.7M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64450K .......... .......... .......... .......... .......... 69% 84.7M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64500K .......... .......... .......... .......... .......... 69% 67.2M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64550K .......... .......... .......... .......... .......... 69% 58.6M 0s 2020-04-28T13:00:01.715 INFO:teuthology.orchestra.run.smithi176.stderr: 64600K .......... .......... .......... .......... .......... 69% 122M 0s 2020-04-28T13:00:01.716 INFO:teuthology.orchestra.run.smithi176.stderr: 64650K .......... .......... .......... .......... .......... 69% 71.5M 0s 2020-04-28T13:00:01.716 INFO:teuthology.orchestra.run.smithi176.stderr: 64700K .......... .......... .......... .......... .......... 69% 76.0M 0s 2020-04-28T13:00:01.716 INFO:teuthology.orchestra.run.smithi176.stderr: 64750K .......... .......... .......... .......... .......... 69% 71.8M 0s 2020-04-28T13:00:01.716 INFO:teuthology.orchestra.run.smithi176.stderr: 64800K .......... .......... .......... .......... .......... 69% 114M 0s 2020-04-28T13:00:01.717 INFO:teuthology.orchestra.run.smithi176.stderr: 64850K .......... .......... .......... .......... .......... 69% 68.2M 0s 2020-04-28T13:00:01.717 INFO:teuthology.orchestra.run.smithi176.stderr: 64900K .......... .......... .......... .......... .......... 69% 69.5M 0s 2020-04-28T13:00:01.717 INFO:teuthology.orchestra.run.smithi176.stderr: 64950K .......... .......... .......... .......... .......... 69% 74.4M 0s 2020-04-28T13:00:01.718 INFO:teuthology.orchestra.run.smithi176.stderr: 65000K .......... .......... .......... .......... .......... 70% 70.2M 0s 2020-04-28T13:00:01.718 INFO:teuthology.orchestra.run.smithi176.stderr: 65050K .......... .......... .......... .......... .......... 70% 120M 0s 2020-04-28T13:00:01.718 INFO:teuthology.orchestra.run.smithi176.stderr: 65100K .......... .......... .......... .......... .......... 70% 83.0M 0s 2020-04-28T13:00:01.719 INFO:teuthology.orchestra.run.smithi176.stderr: 65150K .......... .......... .......... .......... .......... 70% 83.7M 0s 2020-04-28T13:00:01.719 INFO:teuthology.orchestra.run.smithi176.stderr: 65200K .......... .......... .......... .......... .......... 70% 66.9M 0s 2020-04-28T13:00:01.719 INFO:teuthology.orchestra.run.smithi176.stderr: 65250K .......... .......... .......... .......... .......... 70% 123M 0s 2020-04-28T13:00:01.720 INFO:teuthology.orchestra.run.smithi176.stderr: 65300K .......... .......... .......... .......... .......... 70% 74.9M 0s 2020-04-28T13:00:01.720 INFO:teuthology.orchestra.run.smithi176.stderr: 65350K .......... .......... .......... .......... .......... 70% 62.5M 0s 2020-04-28T13:00:01.720 INFO:teuthology.orchestra.run.smithi176.stderr: 65400K .......... .......... .......... .......... .......... 70% 87.0M 0s 2020-04-28T13:00:01.720 INFO:teuthology.orchestra.run.smithi176.stderr: 65450K .......... .......... .......... .......... .......... 70% 89.1M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65500K .......... .......... .......... .......... .......... 70% 70.0M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65550K .......... .......... .......... .......... .......... 70% 110M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65600K .......... .......... .......... .......... .......... 70% 84.7M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65650K .......... .......... .......... .......... .......... 70% 73.6M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65700K .......... .......... .......... .......... .......... 70% 69.8M 0s 2020-04-28T13:00:01.721 INFO:teuthology.orchestra.run.smithi176.stderr: 65750K .......... .......... .......... .......... .......... 70% 62.1M 0s 2020-04-28T13:00:01.722 INFO:teuthology.orchestra.run.smithi176.stderr: 65800K .......... .......... .......... .......... .......... 70% 134M 0s 2020-04-28T13:00:01.722 INFO:teuthology.orchestra.run.smithi176.stderr: 65850K .......... .......... .......... .......... .......... 70% 73.9M 0s 2020-04-28T13:00:01.722 INFO:teuthology.orchestra.run.smithi176.stderr: 65900K .......... .......... .......... .......... .......... 70% 93.3M 0s 2020-04-28T13:00:01.722 INFO:teuthology.orchestra.run.smithi176.stderr: 65950K .......... .......... .......... .......... .......... 71% 65.0M 0s 2020-04-28T13:00:01.722 INFO:teuthology.orchestra.run.smithi176.stderr: 66000K .......... .......... .......... .......... .......... 71% 126M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66050K .......... .......... .......... .......... .......... 71% 92.3M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66100K .......... .......... .......... .......... .......... 71% 69.4M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66150K .......... .......... .......... .......... .......... 71% 62.1M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66200K .......... .......... .......... .......... .......... 71% 77.4M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66250K .......... .......... .......... .......... .......... 71% 71.4M 0s 2020-04-28T13:00:01.723 INFO:teuthology.orchestra.run.smithi176.stderr: 66300K .......... .......... .......... .......... .......... 71% 125M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66350K .......... .......... .......... .......... .......... 71% 75.6M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66400K .......... .......... .......... .......... .......... 71% 89.6M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66450K .......... .......... .......... .......... .......... 71% 67.5M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66500K .......... .......... .......... .......... .......... 71% 119M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66550K .......... .......... .......... .......... .......... 71% 68.8M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66600K .......... .......... .......... .......... .......... 71% 84.4M 0s 2020-04-28T13:00:01.724 INFO:teuthology.orchestra.run.smithi176.stderr: 66650K .......... .......... .......... .......... .......... 71% 72.2M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66700K .......... .......... .......... .......... .......... 71% 77.4M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66750K .......... .......... .......... .......... .......... 71% 113M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66800K .......... .......... .......... .......... .......... 71% 88.0M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66850K .......... .......... .......... .......... .......... 72% 72.7M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66900K .......... .......... .......... .......... .......... 72% 79.5M 0s 2020-04-28T13:00:01.725 INFO:teuthology.orchestra.run.smithi176.stderr: 66950K .......... .......... .......... .......... .......... 72% 67.0M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67000K .......... .......... .......... .......... .......... 72% 102M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67050K .......... .......... .......... .......... .......... 72% 85.0M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67100K .......... .......... .......... .......... .......... 72% 81.1M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67150K .......... .......... .......... .......... .......... 72% 78.1M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67200K .......... .......... .......... .......... .......... 72% 80.7M 0s 2020-04-28T13:00:01.726 INFO:teuthology.orchestra.run.smithi176.stderr: 67250K .......... .......... .......... .......... .......... 72% 114M 0s 2020-04-28T13:00:01.727 INFO:teuthology.orchestra.run.smithi176.stderr: 67300K .......... .......... .......... .......... .......... 72% 79.0M 0s 2020-04-28T13:00:01.727 INFO:teuthology.orchestra.run.smithi176.stderr: 67350K .......... .......... .......... .......... .......... 72% 64.3M 0s 2020-04-28T13:00:01.727 INFO:teuthology.orchestra.run.smithi176.stderr: 67400K .......... .......... .......... .......... .......... 72% 57.6M 0s 2020-04-28T13:00:01.727 INFO:teuthology.orchestra.run.smithi176.stderr: 67450K .......... .......... .......... .......... .......... 72% 137M 0s 2020-04-28T13:00:01.727 INFO:teuthology.orchestra.run.smithi176.stderr: 67500K .......... .......... .......... .......... .......... 72% 118M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67550K .......... .......... .......... .......... .......... 72% 96.7M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67600K .......... .......... .......... .......... .......... 72% 65.6M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67650K .......... .......... .......... .......... .......... 72% 74.9M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67700K .......... .......... .......... .......... .......... 72% 127M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67750K .......... .......... .......... .......... .......... 72% 67.0M 0s 2020-04-28T13:00:01.728 INFO:teuthology.orchestra.run.smithi176.stderr: 67800K .......... .......... .......... .......... .......... 73% 83.0M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 67850K .......... .......... .......... .......... .......... 73% 75.8M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 67900K .......... .......... .......... .......... .......... 73% 84.8M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 67950K .......... .......... .......... .......... .......... 73% 73.6M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 68000K .......... .......... .......... .......... .......... 73% 118M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 68050K .......... .......... .......... .......... .......... 73% 92.9M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 68100K .......... .......... .......... .......... .......... 73% 67.5M 0s 2020-04-28T13:00:01.729 INFO:teuthology.orchestra.run.smithi176.stderr: 68150K .......... .......... .......... .......... .......... 73% 47.9M 0s 2020-04-28T13:00:01.730 INFO:teuthology.orchestra.run.smithi176.stderr: 68200K .......... .......... .......... .......... .......... 73% 167M 0s 2020-04-28T13:00:01.730 INFO:teuthology.orchestra.run.smithi176.stderr: 68250K .......... .......... .......... .......... .......... 73% 111M 0s 2020-04-28T13:00:01.730 INFO:teuthology.orchestra.run.smithi176.stderr: 68300K .......... .......... .......... .......... .......... 73% 75.3M 0s 2020-04-28T13:00:01.730 INFO:teuthology.orchestra.run.smithi176.stderr: 68350K .......... .......... .......... .......... .......... 73% 66.2M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68400K .......... .......... .......... .......... .......... 73% 134M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68450K .......... .......... .......... .......... .......... 73% 120M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68500K .......... .......... .......... .......... .......... 73% 71.1M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68550K .......... .......... .......... .......... .......... 73% 65.1M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68600K .......... .......... .......... .......... .......... 73% 78.7M 0s 2020-04-28T13:00:01.731 INFO:teuthology.orchestra.run.smithi176.stderr: 68650K .......... .......... .......... .......... .......... 73% 86.6M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68700K .......... .......... .......... .......... .......... 74% 123M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68750K .......... .......... .......... .......... .......... 74% 67.0M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68800K .......... .......... .......... .......... .......... 74% 77.8M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68850K .......... .......... .......... .......... .......... 74% 84.3M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68900K .......... .......... .......... .......... .......... 74% 89.4M 0s 2020-04-28T13:00:01.732 INFO:teuthology.orchestra.run.smithi176.stderr: 68950K .......... .......... .......... .......... .......... 74% 65.8M 0s 2020-04-28T13:00:01.733 INFO:teuthology.orchestra.run.smithi176.stderr: 69000K .......... .......... .......... .......... .......... 74% 100M 0s 2020-04-28T13:00:01.733 INFO:teuthology.orchestra.run.smithi176.stderr: 69050K .......... .......... .......... .......... .......... 74% 74.2M 0s 2020-04-28T13:00:01.733 INFO:teuthology.orchestra.run.smithi176.stderr: 69100K .......... .......... .......... .......... .......... 74% 97.5M 0s 2020-04-28T13:00:01.733 INFO:teuthology.orchestra.run.smithi176.stderr: 69150K .......... .......... .......... .......... .......... 74% 58.1M 0s 2020-04-28T13:00:01.733 INFO:teuthology.orchestra.run.smithi176.stderr: 69200K .......... .......... .......... .......... .......... 74% 163M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69250K .......... .......... .......... .......... .......... 74% 77.1M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69300K .......... .......... .......... .......... .......... 74% 88.0M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69350K .......... .......... .......... .......... .......... 74% 66.8M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69400K .......... .......... .......... .......... .......... 74% 75.2M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69450K .......... .......... .......... .......... .......... 74% 120M 0s 2020-04-28T13:00:01.734 INFO:teuthology.orchestra.run.smithi176.stderr: 69500K .......... .......... .......... .......... .......... 74% 79.9M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69550K .......... .......... .......... .......... .......... 74% 77.7M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69600K .......... .......... .......... .......... .......... 74% 78.0M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69650K .......... .......... .......... .......... .......... 75% 64.4M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69700K .......... .......... .......... .......... .......... 75% 114M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69750K .......... .......... .......... .......... .......... 75% 77.6M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69800K .......... .......... .......... .......... .......... 75% 82.1M 0s 2020-04-28T13:00:01.735 INFO:teuthology.orchestra.run.smithi176.stderr: 69850K .......... .......... .......... .......... .......... 75% 92.6M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 69900K .......... .......... .......... .......... .......... 75% 64.6M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 69950K .......... .......... .......... .......... .......... 75% 119M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70000K .......... .......... .......... .......... .......... 75% 76.5M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70050K .......... .......... .......... .......... .......... 75% 81.9M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70100K .......... .......... .......... .......... .......... 75% 84.8M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70150K .......... .......... .......... .......... .......... 75% 60.1M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70200K .......... .......... .......... .......... .......... 75% 97.5M 0s 2020-04-28T13:00:01.736 INFO:teuthology.orchestra.run.smithi176.stderr: 70250K .......... .......... .......... .......... .......... 75% 90.1M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70300K .......... .......... .......... .......... .......... 75% 83.3M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70350K .......... .......... .......... .......... .......... 75% 76.9M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70400K .......... .......... .......... .......... .......... 75% 112M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70450K .......... .......... .......... .......... .......... 75% 68.4M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70500K .......... .......... .......... .......... .......... 75% 78.2M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70550K .......... .......... .......... .......... .......... 75% 60.3M 0s 2020-04-28T13:00:01.737 INFO:teuthology.orchestra.run.smithi176.stderr: 70600K .......... .......... .......... .......... .......... 76% 78.9M 0s 2020-04-28T13:00:01.738 INFO:teuthology.orchestra.run.smithi176.stderr: 70650K .......... .......... .......... .......... .......... 76% 81.6M 0s 2020-04-28T13:00:01.738 INFO:teuthology.orchestra.run.smithi176.stderr: 70700K .......... .......... .......... .......... .......... 76% 112M 0s 2020-04-28T13:00:01.738 INFO:teuthology.orchestra.run.smithi176.stderr: 70750K .......... .......... .......... .......... .......... 76% 80.1M 0s 2020-04-28T13:00:01.738 INFO:teuthology.orchestra.run.smithi176.stderr: 70800K .......... .......... .......... .......... .......... 76% 75.2M 0s 2020-04-28T13:00:01.738 INFO:teuthology.orchestra.run.smithi176.stderr: 70850K .......... .......... .......... .......... .......... 76% 84.0M 0s 2020-04-28T13:00:01.739 INFO:teuthology.orchestra.run.smithi176.stderr: 70900K .......... .......... .......... .......... .......... 76% 110M 0s 2020-04-28T13:00:01.739 INFO:teuthology.orchestra.run.smithi176.stderr: 70950K .......... .......... .......... .......... .......... 76% 81.5M 0s 2020-04-28T13:00:01.739 INFO:teuthology.orchestra.run.smithi176.stderr: 71000K .......... .......... .......... .......... .......... 76% 66.9M 0s 2020-04-28T13:00:01.739 INFO:teuthology.orchestra.run.smithi176.stderr: 71050K .......... .......... .......... .......... .......... 76% 83.2M 0s 2020-04-28T13:00:01.740 INFO:teuthology.orchestra.run.smithi176.stderr: 71100K .......... .......... .......... .......... .......... 76% 78.1M 0s 2020-04-28T13:00:01.740 INFO:teuthology.orchestra.run.smithi176.stderr: 71150K .......... .......... .......... .......... .......... 76% 119M 0s 2020-04-28T13:00:01.740 INFO:teuthology.orchestra.run.smithi176.stderr: 71200K .......... .......... .......... .......... .......... 76% 79.4M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71250K .......... .......... .......... .......... .......... 76% 76.1M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71300K .......... .......... .......... .......... .......... 76% 83.8M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71350K .......... .......... .......... .......... .......... 76% 56.1M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71400K .......... .......... .......... .......... .......... 76% 93.2M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71450K .......... .......... .......... .......... .......... 76% 124M 0s 2020-04-28T13:00:01.741 INFO:teuthology.orchestra.run.smithi176.stderr: 71500K .......... .......... .......... .......... .......... 77% 77.2M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71550K .......... .......... .......... .......... .......... 77% 82.4M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71600K .......... .......... .......... .......... .......... 77% 70.9M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71650K .......... .......... .......... .......... .......... 77% 131M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71700K .......... .......... .......... .......... .......... 77% 83.6M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71750K .......... .......... .......... .......... .......... 77% 66.0M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71800K .......... .......... .......... .......... .......... 77% 79.7M 0s 2020-04-28T13:00:01.742 INFO:teuthology.orchestra.run.smithi176.stderr: 71850K .......... .......... .......... .......... .......... 77% 81.5M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 71900K .......... .......... .......... .......... .......... 77% 113M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 71950K .......... .......... .......... .......... .......... 77% 75.9M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 72000K .......... .......... .......... .......... .......... 77% 75.9M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 72050K .......... .......... .......... .......... .......... 77% 83.5M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 72100K .......... .......... .......... .......... .......... 77% 114M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 72150K .......... .......... .......... .......... .......... 77% 48.5M 0s 2020-04-28T13:00:01.743 INFO:teuthology.orchestra.run.smithi176.stderr: 72200K .......... .......... .......... .......... .......... 77% 106M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72250K .......... .......... .......... .......... .......... 77% 100M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72300K .......... .......... .......... .......... .......... 77% 78.8M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72350K .......... .......... .......... .......... .......... 77% 85.2M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72400K .......... .......... .......... .......... .......... 77% 103M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72450K .......... .......... .......... .......... .......... 78% 83.5M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72500K .......... .......... .......... .......... .......... 78% 98.1M 0s 2020-04-28T13:00:01.744 INFO:teuthology.orchestra.run.smithi176.stderr: 72550K .......... .......... .......... .......... .......... 78% 58.8M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72600K .......... .......... .......... .......... .......... 78% 73.8M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72650K .......... .......... .......... .......... .......... 78% 160M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72700K .......... .......... .......... .......... .......... 78% 74.8M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72750K .......... .......... .......... .......... .......... 78% 77.5M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72800K .......... .......... .......... .......... .......... 78% 80.9M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72850K .......... .......... .......... .......... .......... 78% 113M 0s 2020-04-28T13:00:01.745 INFO:teuthology.orchestra.run.smithi176.stderr: 72900K .......... .......... .......... .......... .......... 78% 90.9M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 72950K .......... .......... .......... .......... .......... 78% 59.1M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73000K .......... .......... .......... .......... .......... 78% 90.3M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73050K .......... .......... .......... .......... .......... 78% 77.8M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73100K .......... .......... .......... .......... .......... 78% 89.6M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73150K .......... .......... .......... .......... .......... 78% 87.2M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73200K .......... .......... .......... .......... .......... 78% 78.0M 0s 2020-04-28T13:00:01.746 INFO:teuthology.orchestra.run.smithi176.stderr: 73250K .......... .......... .......... .......... .......... 78% 80.9M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73300K .......... .......... .......... .......... .......... 78% 79.4M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73350K .......... .......... .......... .......... .......... 79% 71.6M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73400K .......... .......... .......... .......... .......... 79% 123M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73450K .......... .......... .......... .......... .......... 79% 77.4M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73500K .......... .......... .......... .......... .......... 79% 77.5M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73550K .......... .......... .......... .......... .......... 79% 76.2M 0s 2020-04-28T13:00:01.747 INFO:teuthology.orchestra.run.smithi176.stderr: 73600K .......... .......... .......... .......... .......... 79% 122M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73650K .......... .......... .......... .......... .......... 79% 84.6M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73700K .......... .......... .......... .......... .......... 79% 75.0M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73750K .......... .......... .......... .......... .......... 79% 60.2M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73800K .......... .......... .......... .......... .......... 79% 91.2M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73850K .......... .......... .......... .......... .......... 79% 71.5M 0s 2020-04-28T13:00:01.748 INFO:teuthology.orchestra.run.smithi176.stderr: 73900K .......... .......... .......... .......... .......... 79% 116M 0s 2020-04-28T13:00:01.749 INFO:teuthology.orchestra.run.smithi176.stderr: 73950K .......... .......... .......... .......... .......... 79% 80.5M 0s 2020-04-28T13:00:01.749 INFO:teuthology.orchestra.run.smithi176.stderr: 74000K .......... .......... .......... .......... .......... 79% 87.6M 0s 2020-04-28T13:00:01.749 INFO:teuthology.orchestra.run.smithi176.stderr: 74050K .......... .......... .......... .......... .......... 79% 75.5M 0s 2020-04-28T13:00:01.749 INFO:teuthology.orchestra.run.smithi176.stderr: 74100K .......... .......... .......... .......... .......... 79% 96.6M 0s 2020-04-28T13:00:01.749 INFO:teuthology.orchestra.run.smithi176.stderr: 74150K .......... .......... .......... .......... .......... 79% 73.4M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74200K .......... .......... .......... .......... .......... 79% 84.6M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74250K .......... .......... .......... .......... .......... 79% 93.3M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74300K .......... .......... .......... .......... .......... 80% 74.3M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74350K .......... .......... .......... .......... .......... 80% 108M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74400K .......... .......... .......... .......... .......... 80% 78.1M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74450K .......... .......... .......... .......... .......... 80% 82.7M 0s 2020-04-28T13:00:01.750 INFO:teuthology.orchestra.run.smithi176.stderr: 74500K .......... .......... .......... .......... .......... 80% 87.6M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74550K .......... .......... .......... .......... .......... 80% 74.4M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74600K .......... .......... .......... .......... .......... 80% 97.8M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74650K .......... .......... .......... .......... .......... 80% 83.8M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74700K .......... .......... .......... .......... .......... 80% 82.1M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74750K .......... .......... .......... .......... .......... 80% 85.9M 0s 2020-04-28T13:00:01.751 INFO:teuthology.orchestra.run.smithi176.stderr: 74800K .......... .......... .......... .......... .......... 80% 68.9M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 74850K .......... .......... .......... .......... .......... 80% 118M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 74900K .......... .......... .......... .......... .......... 80% 94.1M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 74950K .......... .......... .......... .......... .......... 80% 45.2M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 75000K .......... .......... .......... .......... .......... 80% 154M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 75050K .......... .......... .......... .......... .......... 80% 65.1M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 75100K .......... .......... .......... .......... .......... 80% 123M 0s 2020-04-28T13:00:01.752 INFO:teuthology.orchestra.run.smithi176.stderr: 75150K .......... .......... .......... .......... .......... 80% 90.6M 0s 2020-04-28T13:00:01.753 INFO:teuthology.orchestra.run.smithi176.stderr: 75200K .......... .......... .......... .......... .......... 81% 71.3M 0s 2020-04-28T13:00:01.753 INFO:teuthology.orchestra.run.smithi176.stderr: 75250K .......... .......... .......... .......... .......... 81% 67.7M 0s 2020-04-28T13:00:01.753 INFO:teuthology.orchestra.run.smithi176.stderr: 75300K .......... .......... .......... .......... .......... 81% 114M 0s 2020-04-28T13:00:01.753 INFO:teuthology.orchestra.run.smithi176.stderr: 75350K .......... .......... .......... .......... .......... 81% 79.7M 0s 2020-04-28T13:00:01.753 INFO:teuthology.orchestra.run.smithi176.stderr: 75400K .......... .......... .......... .......... .......... 81% 82.5M 0s 2020-04-28T13:00:01.754 INFO:teuthology.orchestra.run.smithi176.stderr: 75450K .......... .......... .......... .......... .......... 81% 91.2M 0s 2020-04-28T13:00:01.754 INFO:teuthology.orchestra.run.smithi176.stderr: 75500K .......... .......... .......... .......... .......... 81% 80.0M 0s 2020-04-28T13:00:01.754 INFO:teuthology.orchestra.run.smithi176.stderr: 75550K .......... .......... .......... .......... .......... 81% 68.9M 0s 2020-04-28T13:00:01.754 INFO:teuthology.orchestra.run.smithi176.stderr: 75600K .......... .......... .......... .......... .......... 81% 119M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75650K .......... .......... .......... .......... .......... 81% 70.9M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75700K .......... .......... .......... .......... .......... 81% 71.8M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75750K .......... .......... .......... .......... .......... 81% 66.3M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75800K .......... .......... .......... .......... .......... 81% 70.4M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75850K .......... .......... .......... .......... .......... 81% 112M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75900K .......... .......... .......... .......... .......... 81% 57.1M 0s 2020-04-28T13:00:01.755 INFO:teuthology.orchestra.run.smithi176.stderr: 75950K .......... .......... .......... .......... .......... 81% 87.1M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76000K .......... .......... .......... .......... .......... 81% 88.6M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76050K .......... .......... .......... .......... .......... 81% 110M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76100K .......... .......... .......... .......... .......... 81% 61.8M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76150K .......... .......... .......... .......... .......... 82% 57.2M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76200K .......... .......... .......... .......... .......... 82% 72.9M 0s 2020-04-28T13:00:01.756 INFO:teuthology.orchestra.run.smithi176.stderr: 76250K .......... .......... .......... .......... .......... 82% 72.3M 0s 2020-04-28T13:00:01.757 INFO:teuthology.orchestra.run.smithi176.stderr: 76300K .......... .......... .......... .......... .......... 82% 112M 0s 2020-04-28T13:00:01.757 INFO:teuthology.orchestra.run.smithi176.stderr: 76350K .......... .......... .......... .......... .......... 82% 70.9M 0s 2020-04-28T13:00:01.757 INFO:teuthology.orchestra.run.smithi176.stderr: 76400K .......... .......... .......... .......... .......... 82% 71.8M 0s 2020-04-28T13:00:01.757 INFO:teuthology.orchestra.run.smithi176.stderr: 76450K .......... .......... .......... .......... .......... 82% 56.4M 0s 2020-04-28T13:00:01.757 INFO:teuthology.orchestra.run.smithi176.stderr: 76500K .......... .......... .......... .......... .......... 82% 97.2M 0s 2020-04-28T13:00:01.758 INFO:teuthology.orchestra.run.smithi176.stderr: 76550K .......... .......... .......... .......... .......... 82% 67.9M 0s 2020-04-28T13:00:01.758 INFO:teuthology.orchestra.run.smithi176.stderr: 76600K .......... .......... .......... .......... .......... 82% 116M 0s 2020-04-28T13:00:01.758 INFO:teuthology.orchestra.run.smithi176.stderr: 76650K .......... .......... .......... .......... .......... 82% 66.4M 0s 2020-04-28T13:00:01.758 INFO:teuthology.orchestra.run.smithi176.stderr: 76700K .......... .......... .......... .......... .......... 82% 71.7M 0s 2020-04-28T13:00:01.758 INFO:teuthology.orchestra.run.smithi176.stderr: 76750K .......... .......... .......... .......... .......... 82% 74.2M 0s 2020-04-28T13:00:01.759 INFO:teuthology.orchestra.run.smithi176.stderr: 76800K .......... .......... .......... .......... .......... 82% 133M 0s 2020-04-28T13:00:01.759 INFO:teuthology.orchestra.run.smithi176.stderr: 76850K .......... .......... .......... .......... .......... 82% 71.0M 0s 2020-04-28T13:00:01.759 INFO:teuthology.orchestra.run.smithi176.stderr: 76900K .......... .......... .......... .......... .......... 82% 73.5M 0s 2020-04-28T13:00:01.759 INFO:teuthology.orchestra.run.smithi176.stderr: 76950K .......... .......... .......... .......... .......... 82% 62.3M 0s 2020-04-28T13:00:01.760 INFO:teuthology.orchestra.run.smithi176.stderr: 77000K .......... .......... .......... .......... .......... 82% 87.4M 0s 2020-04-28T13:00:01.760 INFO:teuthology.orchestra.run.smithi176.stderr: 77050K .......... .......... .......... .......... .......... 82% 104M 0s 2020-04-28T13:00:01.760 INFO:teuthology.orchestra.run.smithi176.stderr: 77100K .......... .......... .......... .......... .......... 83% 66.9M 0s 2020-04-28T13:00:01.761 INFO:teuthology.orchestra.run.smithi176.stderr: 77150K .......... .......... .......... .......... .......... 83% 88.9M 0s 2020-04-28T13:00:01.761 INFO:teuthology.orchestra.run.smithi176.stderr: 77200K .......... .......... .......... .......... .......... 83% 76.5M 0s 2020-04-28T13:00:01.761 INFO:teuthology.orchestra.run.smithi176.stderr: 77250K .......... .......... .......... .......... .......... 83% 93.0M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77300K .......... .......... .......... .......... .......... 83% 122M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77350K .......... .......... .......... .......... .......... 83% 58.5M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77400K .......... .......... .......... .......... .......... 83% 66.0M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77450K .......... .......... .......... .......... .......... 83% 87.3M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77500K .......... .......... .......... .......... .......... 83% 69.1M 0s 2020-04-28T13:00:01.762 INFO:teuthology.orchestra.run.smithi176.stderr: 77550K .......... .......... .......... .......... .......... 83% 75.6M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77600K .......... .......... .......... .......... .......... 83% 154M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77650K .......... .......... .......... .......... .......... 83% 93.7M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77700K .......... .......... .......... .......... .......... 83% 85.2M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77750K .......... .......... .......... .......... .......... 83% 64.7M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77800K .......... .......... .......... .......... .......... 83% 104M 0s 2020-04-28T13:00:01.763 INFO:teuthology.orchestra.run.smithi176.stderr: 77850K .......... .......... .......... .......... .......... 83% 77.0M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 77900K .......... .......... .......... .......... .......... 83% 58.4M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 77950K .......... .......... .......... .......... .......... 83% 123M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 78000K .......... .......... .......... .......... .......... 84% 116M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 78050K .......... .......... .......... .......... .......... 84% 92.8M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 78100K .......... .......... .......... .......... .......... 84% 64.5M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 78150K .......... .......... .......... .......... .......... 84% 57.2M 0s 2020-04-28T13:00:01.764 INFO:teuthology.orchestra.run.smithi176.stderr: 78200K .......... .......... .......... .......... .......... 84% 99.3M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78250K .......... .......... .......... .......... .......... 84% 73.6M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78300K .......... .......... .......... .......... .......... 84% 103M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78350K .......... .......... .......... .......... .......... 84% 82.3M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78400K .......... .......... .......... .......... .......... 84% 91.4M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78450K .......... .......... .......... .......... .......... 84% 78.4M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78500K .......... .......... .......... .......... .......... 84% 118M 0s 2020-04-28T13:00:01.765 INFO:teuthology.orchestra.run.smithi176.stderr: 78550K .......... .......... .......... .......... .......... 84% 68.0M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78600K .......... .......... .......... .......... .......... 84% 83.9M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78650K .......... .......... .......... .......... .......... 84% 69.9M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78700K .......... .......... .......... .......... .......... 84% 92.5M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78750K .......... .......... .......... .......... .......... 84% 89.5M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78800K .......... .......... .......... .......... .......... 84% 79.4M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78850K .......... .......... .......... .......... .......... 84% 86.5M 0s 2020-04-28T13:00:01.766 INFO:teuthology.orchestra.run.smithi176.stderr: 78900K .......... .......... .......... .......... .......... 84% 86.0M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 78950K .......... .......... .......... .......... .......... 85% 65.0M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79000K .......... .......... .......... .......... .......... 85% 72.2M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79050K .......... .......... .......... .......... .......... 85% 95.8M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79100K .......... .......... .......... .......... .......... 85% 88.7M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79150K .......... .......... .......... .......... .......... 85% 90.1M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79200K .......... .......... .......... .......... .......... 85% 70.4M 0s 2020-04-28T13:00:01.767 INFO:teuthology.orchestra.run.smithi176.stderr: 79250K .......... .......... .......... .......... .......... 85% 102M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79300K .......... .......... .......... .......... .......... 85% 89.1M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79350K .......... .......... .......... .......... .......... 85% 60.6M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79400K .......... .......... .......... .......... .......... 85% 74.9M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79450K .......... .......... .......... .......... .......... 85% 81.0M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79500K .......... .......... .......... .......... .......... 85% 117M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79550K .......... .......... .......... .......... .......... 85% 81.9M 0s 2020-04-28T13:00:01.768 INFO:teuthology.orchestra.run.smithi176.stderr: 79600K .......... .......... .......... .......... .......... 85% 80.9M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79650K .......... .......... .......... .......... .......... 85% 72.0M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79700K .......... .......... .......... .......... .......... 85% 118M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79750K .......... .......... .......... .......... .......... 85% 53.3M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79800K .......... .......... .......... .......... .......... 85% 118M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79850K .......... .......... .......... .......... .......... 86% 80.7M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79900K .......... .......... .......... .......... .......... 86% 93.4M 0s 2020-04-28T13:00:01.769 INFO:teuthology.orchestra.run.smithi176.stderr: 79950K .......... .......... .......... .......... .......... 86% 64.1M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80000K .......... .......... .......... .......... .......... 86% 113M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80050K .......... .......... .......... .......... .......... 86% 83.2M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80100K .......... .......... .......... .......... .......... 86% 79.2M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80150K .......... .......... .......... .......... .......... 86% 64.6M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80200K .......... .......... .......... .......... .......... 86% 78.5M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80250K .......... .......... .......... .......... .......... 86% 114M 0s 2020-04-28T13:00:01.770 INFO:teuthology.orchestra.run.smithi176.stderr: 80300K .......... .......... .......... .......... .......... 86% 80.6M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80350K .......... .......... .......... .......... .......... 86% 74.9M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80400K .......... .......... .......... .......... .......... 86% 79.0M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80450K .......... .......... .......... .......... .......... 86% 121M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80500K .......... .......... .......... .......... .......... 86% 82.2M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80550K .......... .......... .......... .......... .......... 86% 65.1M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80600K .......... .......... .......... .......... .......... 86% 77.4M 0s 2020-04-28T13:00:01.771 INFO:teuthology.orchestra.run.smithi176.stderr: 80650K .......... .......... .......... .......... .......... 86% 78.2M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80700K .......... .......... .......... .......... .......... 86% 78.6M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80750K .......... .......... .......... .......... .......... 86% 115M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80800K .......... .......... .......... .......... .......... 87% 83.6M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80850K .......... .......... .......... .......... .......... 87% 75.5M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80900K .......... .......... .......... .......... .......... 87% 77.3M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 80950K .......... .......... .......... .......... .......... 87% 66.9M 0s 2020-04-28T13:00:01.772 INFO:teuthology.orchestra.run.smithi176.stderr: 81000K .......... .......... .......... .......... .......... 87% 116M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81050K .......... .......... .......... .......... .......... 87% 79.9M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81100K .......... .......... .......... .......... .......... 87% 77.1M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81150K .......... .......... .......... .......... .......... 87% 80.8M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81200K .......... .......... .......... .......... .......... 87% 108M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81250K .......... .......... .......... .......... .......... 87% 82.3M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81300K .......... .......... .......... .......... .......... 87% 83.0M 0s 2020-04-28T13:00:01.773 INFO:teuthology.orchestra.run.smithi176.stderr: 81350K .......... .......... .......... .......... .......... 87% 68.1M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81400K .......... .......... .......... .......... .......... 87% 93.7M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81450K .......... .......... .......... .......... .......... 87% 74.4M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81500K .......... .......... .......... .......... .......... 87% 122M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81550K .......... .......... .......... .......... .......... 87% 69.1M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81600K .......... .......... .......... .......... .......... 87% 81.0M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81650K .......... .......... .......... .......... .......... 87% 87.0M 0s 2020-04-28T13:00:01.774 INFO:teuthology.orchestra.run.smithi176.stderr: 81700K .......... .......... .......... .......... .......... 87% 115M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 81750K .......... .......... .......... .......... .......... 88% 60.1M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 81800K .......... .......... .......... .......... .......... 88% 70.2M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 81850K .......... .......... .......... .......... .......... 88% 79.2M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 81900K .......... .......... .......... .......... .......... 88% 87.2M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 81950K .......... .......... .......... .......... .......... 88% 112M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 82000K .......... .......... .......... .......... .......... 88% 68.2M 0s 2020-04-28T13:00:01.775 INFO:teuthology.orchestra.run.smithi176.stderr: 82050K .......... .......... .......... .......... .......... 88% 78.9M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82100K .......... .......... .......... .......... .......... 88% 77.8M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82150K .......... .......... .......... .......... .......... 88% 73.9M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82200K .......... .......... .......... .......... .......... 88% 113M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82250K .......... .......... .......... .......... .......... 88% 75.3M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82300K .......... .......... .......... .......... .......... 88% 83.9M 0s 2020-04-28T13:00:01.776 INFO:teuthology.orchestra.run.smithi176.stderr: 82350K .......... .......... .......... .......... .......... 88% 73.0M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82400K .......... .......... .......... .......... .......... 88% 80.1M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82450K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82500K .......... .......... .......... .......... .......... 88% 84.0M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82550K .......... .......... .......... .......... .......... 88% 61.5M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82600K .......... .......... .......... .......... .......... 88% 84.3M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82650K .......... .......... .......... .......... .......... 89% 85.6M 0s 2020-04-28T13:00:01.777 INFO:teuthology.orchestra.run.smithi176.stderr: 82700K .......... .......... .......... .......... .......... 89% 116M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 82750K .......... .......... .......... .......... .......... 89% 64.9M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 82800K .......... .......... .......... .......... .......... 89% 76.5M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 82850K .......... .......... .......... .......... .......... 89% 89.4M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 82900K .......... .......... .......... .......... .......... 89% 88.1M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 82950K .......... .......... .......... .......... .......... 89% 73.4M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 83000K .......... .......... .......... .......... .......... 89% 79.5M 0s 2020-04-28T13:00:01.778 INFO:teuthology.orchestra.run.smithi176.stderr: 83050K .......... .......... .......... .......... .......... 89% 72.9M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83100K .......... .......... .......... .......... .......... 89% 91.5M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83150K .......... .......... .......... .......... .......... 89% 68.0M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83200K .......... .......... .......... .......... .......... 89% 119M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83250K .......... .......... .......... .......... .......... 89% 78.3M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83300K .......... .......... .......... .......... .......... 89% 91.9M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83350K .......... .......... .......... .......... .......... 89% 60.7M 0s 2020-04-28T13:00:01.779 INFO:teuthology.orchestra.run.smithi176.stderr: 83400K .......... .......... .......... .......... .......... 89% 72.5M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83450K .......... .......... .......... .......... .......... 89% 108M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83500K .......... .......... .......... .......... .......... 89% 85.8M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83550K .......... .......... .......... .......... .......... 89% 76.1M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83600K .......... .......... .......... .......... .......... 90% 87.3M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83650K .......... .......... .......... .......... .......... 90% 117M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83700K .......... .......... .......... .......... .......... 90% 74.1M 0s 2020-04-28T13:00:01.780 INFO:teuthology.orchestra.run.smithi176.stderr: 83750K .......... .......... .......... .......... .......... 90% 64.8M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 83800K .......... .......... .......... .......... .......... 90% 73.9M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 83850K .......... .......... .......... .......... .......... 90% 82.4M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 83900K .......... .......... .......... .......... .......... 90% 108M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 83950K .......... .......... .......... .......... .......... 90% 79.1M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 84000K .......... .......... .......... .......... .......... 90% 91.2M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 84050K .......... .......... .......... .......... .......... 90% 75.8M 0s 2020-04-28T13:00:01.781 INFO:teuthology.orchestra.run.smithi176.stderr: 84100K .......... .......... .......... .......... .......... 90% 83.7M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84150K .......... .......... .......... .......... .......... 90% 63.2M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84200K .......... .......... .......... .......... .......... 90% 108M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84250K .......... .......... .......... .......... .......... 90% 86.5M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84300K .......... .......... .......... .......... .......... 90% 72.3M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84350K .......... .......... .......... .......... .......... 90% 83.5M 0s 2020-04-28T13:00:01.782 INFO:teuthology.orchestra.run.smithi176.stderr: 84400K .......... .......... .......... .......... .......... 90% 111M 0s 2020-04-28T13:00:01.783 INFO:teuthology.orchestra.run.smithi176.stderr: 84450K .......... .......... .......... .......... .......... 90% 88.4M 0s 2020-04-28T13:00:01.783 INFO:teuthology.orchestra.run.smithi176.stderr: 84500K .......... .......... .......... .......... .......... 91% 89.5M 0s 2020-04-28T13:00:01.783 INFO:teuthology.orchestra.run.smithi176.stderr: 84550K .......... .......... .......... .......... .......... 91% 56.5M 0s 2020-04-28T13:00:01.783 INFO:teuthology.orchestra.run.smithi176.stderr: 84600K .......... .......... .......... .......... .......... 91% 79.7M 0s 2020-04-28T13:00:01.783 INFO:teuthology.orchestra.run.smithi176.stderr: 84650K .......... .......... .......... .......... .......... 91% 106M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84700K .......... .......... .......... .......... .......... 91% 93.1M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84750K .......... .......... .......... .......... .......... 91% 72.1M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84800K .......... .......... .......... .......... .......... 91% 75.4M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84850K .......... .......... .......... .......... .......... 91% 85.7M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84900K .......... .......... .......... .......... .......... 91% 114M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 84950K .......... .......... .......... .......... .......... 91% 67.5M 0s 2020-04-28T13:00:01.784 INFO:teuthology.orchestra.run.smithi176.stderr: 85000K .......... .......... .......... .......... .......... 91% 79.4M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85050K .......... .......... .......... .......... .......... 91% 97.7M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85100K .......... .......... .......... .......... .......... 91% 68.4M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85150K .......... .......... .......... .......... .......... 91% 106M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85200K .......... .......... .......... .......... .......... 91% 80.3M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85250K .......... .......... .......... .......... .......... 91% 82.8M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85300K .......... .......... .......... .......... .......... 91% 78.7M 0s 2020-04-28T13:00:01.785 INFO:teuthology.orchestra.run.smithi176.stderr: 85350K .......... .......... .......... .......... .......... 91% 67.4M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85400K .......... .......... .......... .......... .......... 91% 111M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85450K .......... .......... .......... .......... .......... 92% 88.3M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85500K .......... .......... .......... .......... .......... 92% 82.7M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85550K .......... .......... .......... .......... .......... 92% 64.6M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85600K .......... .......... .......... .......... .......... 92% 129M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85650K .......... .......... .......... .......... .......... 92% 78.4M 0s 2020-04-28T13:00:01.786 INFO:teuthology.orchestra.run.smithi176.stderr: 85700K .......... .......... .......... .......... .......... 92% 84.0M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 85750K .......... .......... .......... .......... .......... 92% 66.7M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 85800K .......... .......... .......... .......... .......... 92% 72.1M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 85850K .......... .......... .......... .......... .......... 92% 74.1M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 85900K .......... .......... .......... .......... .......... 92% 141M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 85950K .......... .......... .......... .......... .......... 92% 72.2M 0s 2020-04-28T13:00:01.787 INFO:teuthology.orchestra.run.smithi176.stderr: 86000K .......... .......... .......... .......... .......... 92% 87.0M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86050K .......... .......... .......... .......... .......... 92% 93.3M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86100K .......... .......... .......... .......... .......... 92% 92.3M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86150K .......... .......... .......... .......... .......... 92% 71.1M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86200K .......... .......... .......... .......... .......... 92% 78.7M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86250K .......... .......... .......... .......... .......... 92% 99.4M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86300K .......... .......... .......... .......... .......... 92% 89.5M 0s 2020-04-28T13:00:01.788 INFO:teuthology.orchestra.run.smithi176.stderr: 86350K .......... .......... .......... .......... .......... 93% 112M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86400K .......... .......... .......... .......... .......... 93% 78.8M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86450K .......... .......... .......... .......... .......... 93% 89.3M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86500K .......... .......... .......... .......... .......... 93% 63.4M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86550K .......... .......... .......... .......... .......... 93% 66.3M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86600K .......... .......... .......... .......... .......... 93% 57.2M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86650K .......... .......... .......... .......... .......... 93% 174M 0s 2020-04-28T13:00:01.789 INFO:teuthology.orchestra.run.smithi176.stderr: 86700K .......... .......... .......... .......... .......... 93% 112M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 86750K .......... .......... .......... .......... .......... 93% 85.0M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 86800K .......... .......... .......... .......... .......... 93% 61.5M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 86850K .......... .......... .......... .......... .......... 93% 114M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 86900K .......... .......... .......... .......... .......... 93% 87.9M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 86950K .......... .......... .......... .......... .......... 93% 67.1M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 87000K .......... .......... .......... .......... .......... 93% 90.3M 0s 2020-04-28T13:00:01.790 INFO:teuthology.orchestra.run.smithi176.stderr: 87050K .......... .......... .......... .......... .......... 93% 72.6M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87100K .......... .......... .......... .......... .......... 93% 114M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87150K .......... .......... .......... .......... .......... 93% 76.5M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87200K .......... .......... .......... .......... .......... 93% 70.5M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87250K .......... .......... .......... .......... .......... 93% 70.3M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87300K .......... .......... .......... .......... .......... 94% 118M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87350K .......... .......... .......... .......... .......... 94% 51.1M 0s 2020-04-28T13:00:01.791 INFO:teuthology.orchestra.run.smithi176.stderr: 87400K .......... .......... .......... .......... .......... 94% 114M 0s 2020-04-28T13:00:01.792 INFO:teuthology.orchestra.run.smithi176.stderr: 87450K .......... .......... .......... .......... .......... 94% 87.9M 0s 2020-04-28T13:00:01.792 INFO:teuthology.orchestra.run.smithi176.stderr: 87500K .......... .......... .......... .......... .......... 94% 67.5M 0s 2020-04-28T13:00:01.792 INFO:teuthology.orchestra.run.smithi176.stderr: 87550K .......... .......... .......... .......... .......... 94% 78.7M 0s 2020-04-28T13:00:01.792 INFO:teuthology.orchestra.run.smithi176.stderr: 87600K .......... .......... .......... .......... .......... 94% 97.2M 0s 2020-04-28T13:00:01.792 INFO:teuthology.orchestra.run.smithi176.stderr: 87650K .......... .......... .......... .......... .......... 94% 86.3M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87700K .......... .......... .......... .......... .......... 94% 80.9M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87750K .......... .......... .......... .......... .......... 94% 62.0M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87800K .......... .......... .......... .......... .......... 94% 79.3M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87850K .......... .......... .......... .......... .......... 94% 119M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87900K .......... .......... .......... .......... .......... 94% 71.0M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 87950K .......... .......... .......... .......... .......... 94% 63.4M 0s 2020-04-28T13:00:01.793 INFO:teuthology.orchestra.run.smithi176.stderr: 88000K .......... .......... .......... .......... .......... 94% 72.0M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88050K .......... .......... .......... .......... .......... 94% 120M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88100K .......... .......... .......... .......... .......... 94% 74.6M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88150K .......... .......... .......... .......... .......... 94% 62.5M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88200K .......... .......... .......... .......... .......... 94% 72.9M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88250K .......... .......... .......... .......... .......... 95% 68.1M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88300K .......... .......... .......... .......... .......... 95% 87.6M 0s 2020-04-28T13:00:01.794 INFO:teuthology.orchestra.run.smithi176.stderr: 88350K .......... .......... .......... .......... .......... 95% 86.4M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88400K .......... .......... .......... .......... .......... 95% 75.8M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88450K .......... .......... .......... .......... .......... 95% 65.2M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88500K .......... .......... .......... .......... .......... 95% 68.9M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88550K .......... .......... .......... .......... .......... 95% 63.6M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88600K .......... .......... .......... .......... .......... 95% 124M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88650K .......... .......... .......... .......... .......... 95% 64.1M 0s 2020-04-28T13:00:01.795 INFO:teuthology.orchestra.run.smithi176.stderr: 88700K .......... .......... .......... .......... .......... 95% 81.6M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 88750K .......... .......... .......... .......... .......... 95% 74.4M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 88800K .......... .......... .......... .......... .......... 95% 121M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 88850K .......... .......... .......... .......... .......... 95% 57.7M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 88900K .......... .......... .......... .......... .......... 95% 77.7M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 88950K .......... .......... .......... .......... .......... 95% 70.1M 0s 2020-04-28T13:00:01.796 INFO:teuthology.orchestra.run.smithi176.stderr: 89000K .......... .......... .......... .......... .......... 95% 75.4M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89050K .......... .......... .......... .......... .......... 95% 79.1M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89100K .......... .......... .......... .......... .......... 95% 120M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89150K .......... .......... .......... .......... .......... 96% 73.3M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89200K .......... .......... .......... .......... .......... 96% 90.9M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89250K .......... .......... .......... .......... .......... 96% 80.4M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89300K .......... .......... .......... .......... .......... 96% 121M 0s 2020-04-28T13:00:01.797 INFO:teuthology.orchestra.run.smithi176.stderr: 89350K .......... .......... .......... .......... .......... 96% 72.7M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89400K .......... .......... .......... .......... .......... 96% 70.9M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89450K .......... .......... .......... .......... .......... 96% 84.6M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89500K .......... .......... .......... .......... .......... 96% 70.8M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89550K .......... .......... .......... .......... .......... 96% 105M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89600K .......... .......... .......... .......... .......... 96% 71.3M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89650K .......... .......... .......... .......... .......... 96% 93.4M 0s 2020-04-28T13:00:01.798 INFO:teuthology.orchestra.run.smithi176.stderr: 89700K .......... .......... .......... .......... .......... 96% 91.8M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 89750K .......... .......... .......... .......... .......... 96% 64.1M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 89800K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 89850K .......... .......... .......... .......... .......... 96% 75.8M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 89900K .......... .......... .......... .......... .......... 96% 79.5M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 89950K .......... .......... .......... .......... .......... 96% 79.3M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 90000K .......... .......... .......... .......... .......... 96% 76.8M 0s 2020-04-28T13:00:01.799 INFO:teuthology.orchestra.run.smithi176.stderr: 90050K .......... .......... .......... .......... .......... 96% 117M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90100K .......... .......... .......... .......... .......... 97% 82.5M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90150K .......... .......... .......... .......... .......... 97% 68.3M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90200K .......... .......... .......... .......... .......... 97% 76.4M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90250K .......... .......... .......... .......... .......... 97% 80.6M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90300K .......... .......... .......... .......... .......... 97% 119M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90350K .......... .......... .......... .......... .......... 97% 74.4M 0s 2020-04-28T13:00:01.800 INFO:teuthology.orchestra.run.smithi176.stderr: 90400K .......... .......... .......... .......... .......... 97% 86.0M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90450K .......... .......... .......... .......... .......... 97% 80.7M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90500K .......... .......... .......... .......... .......... 97% 125M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90550K .......... .......... .......... .......... .......... 97% 61.5M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90600K .......... .......... .......... .......... .......... 97% 85.7M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90650K .......... .......... .......... .......... .......... 97% 84.8M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90700K .......... .......... .......... .......... .......... 97% 72.3M 0s 2020-04-28T13:00:01.801 INFO:teuthology.orchestra.run.smithi176.stderr: 90750K .......... .......... .......... .......... .......... 97% 87.1M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 90800K .......... .......... .......... .......... .......... 97% 117M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 90850K .......... .......... .......... .......... .......... 97% 73.0M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 90900K .......... .......... .......... .......... .......... 97% 83.6M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 90950K .......... .......... .......... .......... .......... 97% 58.6M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 91000K .......... .......... .......... .......... .......... 98% 96.1M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 91050K .......... .......... .......... .......... .......... 98% 89.4M 0s 2020-04-28T13:00:01.802 INFO:teuthology.orchestra.run.smithi176.stderr: 91100K .......... .......... .......... .......... .......... 98% 82.1M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91150K .......... .......... .......... .......... .......... 98% 84.8M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91200K .......... .......... .......... .......... .......... 98% 67.2M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91250K .......... .......... .......... .......... .......... 98% 105M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91300K .......... .......... .......... .......... .......... 98% 88.2M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91350K .......... .......... .......... .......... .......... 98% 70.4M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91400K .......... .......... .......... .......... .......... 98% 58.4M 0s 2020-04-28T13:00:01.803 INFO:teuthology.orchestra.run.smithi176.stderr: 91450K .......... .......... .......... .......... .......... 98% 86.7M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91500K .......... .......... .......... .......... .......... 98% 125M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91550K .......... .......... .......... .......... .......... 98% 77.8M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91600K .......... .......... .......... .......... .......... 98% 76.5M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91650K .......... .......... .......... .......... .......... 98% 78.3M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91700K .......... .......... .......... .......... .......... 98% 75.0M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91750K .......... .......... .......... .......... .......... 98% 79.9M 0s 2020-04-28T13:00:01.804 INFO:teuthology.orchestra.run.smithi176.stderr: 91800K .......... .......... .......... .......... .......... 98% 119M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 91850K .......... .......... .......... .......... .......... 98% 64.2M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 91900K .......... .......... .......... .......... .......... 98% 94.4M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 91950K .......... .......... .......... .......... .......... 99% 72.5M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 92000K .......... .......... .......... .......... .......... 99% 112M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 92050K .......... .......... .......... .......... .......... 99% 76.4M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 92100K .......... .......... .......... .......... .......... 99% 80.5M 0s 2020-04-28T13:00:01.805 INFO:teuthology.orchestra.run.smithi176.stderr: 92150K .......... .......... .......... .......... .......... 99% 70.1M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92200K .......... .......... .......... .......... .......... 99% 72.5M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92250K .......... .......... .......... .......... .......... 99% 114M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92300K .......... .......... .......... .......... .......... 99% 79.2M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92350K .......... .......... .......... .......... .......... 99% 70.9M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92400K .......... .......... .......... .......... .......... 99% 75.7M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92450K .......... .......... .......... .......... .......... 99% 79.4M 0s 2020-04-28T13:00:01.806 INFO:teuthology.orchestra.run.smithi176.stderr: 92500K .......... .......... .......... .......... .......... 99% 116M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92550K .......... .......... .......... .......... .......... 99% 79.6M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92600K .......... .......... .......... .......... .......... 99% 66.7M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92650K .......... .......... .......... .......... .......... 99% 79.8M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92700K .......... .......... .......... .......... .......... 99% 75.5M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92750K .......... .......... .......... .......... .......... 99% 111M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92800K .......... .......... .......... .......... .......... 99% 79.7M 0s 2020-04-28T13:00:01.807 INFO:teuthology.orchestra.run.smithi176.stderr: 92850K .......... .......... .......... .......... .......... 99% 83.7M 0s 2020-04-28T13:00:01.808 INFO:teuthology.orchestra.run.smithi176.stderr: 92900K 100% 134G=1.3s 2020-04-28T13:00:01.808 INFO:teuthology.orchestra.run.smithi176.stderr: 2020-04-28T13:00:01.808 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28 13:00:01 (67.8 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2020-04-28T13:00:01.808 INFO:teuthology.orchestra.run.smithi176.stderr: 2020-04-28T13:00:01.814 INFO:teuthology.orchestra.run.smithi176.stdout:Archive: gradle-6.0.1-bin.zip 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: creating: /opt/gradle/gradle-6.0.1/ 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2020-04-28T13:00:01.815 INFO:teuthology.orchestra.run.smithi176.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2020-04-28T13:00:01.816 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2020-04-28T13:00:01.816 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2020-04-28T13:00:01.816 INFO:teuthology.orchestra.run.smithi176.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2020-04-28T13:00:01.816 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2020-04-28T13:00:01.816 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2020-04-28T13:00:01.817 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2020-04-28T13:00:01.818 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2020-04-28T13:00:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2020-04-28T13:00:01.820 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2020-04-28T13:00:01.821 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2020-04-28T13:00:01.821 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2020-04-28T13:00:01.821 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2020-04-28T13:00:01.942 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2020-04-28T13:00:01.942 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2020-04-28T13:00:01.943 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2020-04-28T13:00:01.943 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2020-04-28T13:00:01.993 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2020-04-28T13:00:01.994 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2020-04-28T13:00:01.994 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2020-04-28T13:00:01.994 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2020-04-28T13:00:01.994 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2020-04-28T13:00:02.010 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2020-04-28T13:00:02.011 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2020-04-28T13:00:02.013 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2020-04-28T13:00:02.014 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2020-04-28T13:00:02.014 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2020-04-28T13:00:02.014 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2020-04-28T13:00:02.015 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2020-04-28T13:00:02.029 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2020-04-28T13:00:02.029 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2020-04-28T13:00:02.029 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2020-04-28T13:00:02.030 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2020-04-28T13:00:02.031 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2020-04-28T13:00:02.032 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2020-04-28T13:00:02.034 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2020-04-28T13:00:02.036 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2020-04-28T13:00:02.036 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2020-04-28T13:00:02.050 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2020-04-28T13:00:02.057 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2020-04-28T13:00:02.057 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2020-04-28T13:00:02.071 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2020-04-28T13:00:02.071 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2020-04-28T13:00:02.071 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2020-04-28T13:00:02.072 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2020-04-28T13:00:02.072 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2020-04-28T13:00:02.072 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2020-04-28T13:00:02.072 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2020-04-28T13:00:02.085 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2020-04-28T13:00:02.085 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2020-04-28T13:00:02.094 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2020-04-28T13:00:02.094 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2020-04-28T13:00:02.094 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2020-04-28T13:00:02.094 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2020-04-28T13:00:02.095 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2020-04-28T13:00:02.102 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2020-04-28T13:00:02.102 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2020-04-28T13:00:02.107 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2020-04-28T13:00:02.107 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2020-04-28T13:00:02.107 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2020-04-28T13:00:02.107 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2020-04-28T13:00:02.107 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2020-04-28T13:00:02.108 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2020-04-28T13:00:02.109 INFO:teuthology.orchestra.run.smithi176.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2020-04-28T13:00:02.110 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2020-04-28T13:00:02.111 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2020-04-28T13:00:02.111 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2020-04-28T13:00:02.111 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2020-04-28T13:00:02.111 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2020-04-28T13:00:02.111 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2020-04-28T13:00:02.113 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2020-04-28T13:00:02.114 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2020-04-28T13:00:02.115 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2020-04-28T13:00:02.116 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2020-04-28T13:00:02.117 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2020-04-28T13:00:02.119 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2020-04-28T13:00:02.120 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2020-04-28T13:00:02.120 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2020-04-28T13:00:02.121 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2020-04-28T13:00:02.122 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2020-04-28T13:00:02.123 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2020-04-28T13:00:02.123 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2020-04-28T13:00:02.125 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2020-04-28T13:00:02.126 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2020-04-28T13:00:02.128 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2020-04-28T13:00:02.128 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2020-04-28T13:00:02.129 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2020-04-28T13:00:02.129 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2020-04-28T13:00:02.130 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2020-04-28T13:00:02.130 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2020-04-28T13:00:02.131 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2020-04-28T13:00:02.133 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2020-04-28T13:00:02.133 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2020-04-28T13:00:02.134 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2020-04-28T13:00:02.137 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2020-04-28T13:00:02.139 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2020-04-28T13:00:02.140 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2020-04-28T13:00:02.141 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2020-04-28T13:00:02.143 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2020-04-28T13:00:02.143 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2020-04-28T13:00:02.149 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2020-04-28T13:00:02.149 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2020-04-28T13:00:02.168 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2020-04-28T13:00:02.168 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2020-04-28T13:00:02.169 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2020-04-28T13:00:02.169 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2020-04-28T13:00:02.169 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2020-04-28T13:00:02.169 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2020-04-28T13:00:02.170 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2020-04-28T13:00:02.170 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2020-04-28T13:00:02.170 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2020-04-28T13:00:02.171 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2020-04-28T13:00:02.183 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2020-04-28T13:00:02.184 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2020-04-28T13:00:02.184 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2020-04-28T13:00:02.184 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2020-04-28T13:00:02.186 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2020-04-28T13:00:02.187 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2020-04-28T13:00:02.194 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2020-04-28T13:00:02.196 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2020-04-28T13:00:02.200 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2020-04-28T13:00:02.200 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2020-04-28T13:00:02.200 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2020-04-28T13:00:02.201 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2020-04-28T13:00:02.202 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2020-04-28T13:00:02.202 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2020-04-28T13:00:02.204 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2020-04-28T13:00:02.212 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2020-04-28T13:00:02.213 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2020-04-28T13:00:02.215 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2020-04-28T13:00:02.215 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2020-04-28T13:00:02.216 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2020-04-28T13:00:02.216 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2020-04-28T13:00:02.216 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2020-04-28T13:00:02.219 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2020-04-28T13:00:02.222 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2020-04-28T13:00:02.224 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2020-04-28T13:00:02.225 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2020-04-28T13:00:02.227 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2020-04-28T13:00:02.229 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2020-04-28T13:00:02.230 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2020-04-28T13:00:02.236 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2020-04-28T13:00:02.239 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2020-04-28T13:00:02.245 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2020-04-28T13:00:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2020-04-28T13:00:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2020-04-28T13:00:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2020-04-28T13:00:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2020-04-28T13:00:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2020-04-28T13:00:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2020-04-28T13:00:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2020-04-28T13:00:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2020-04-28T13:00:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2020-04-28T13:00:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2020-04-28T13:00:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2020-04-28T13:00:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2020-04-28T13:00:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2020-04-28T13:00:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2020-04-28T13:00:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2020-04-28T13:00:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2020-04-28T13:00:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2020-04-28T13:00:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2020-04-28T13:00:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2020-04-28T13:00:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2020-04-28T13:00:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2020-04-28T13:00:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2020-04-28T13:00:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2020-04-28T13:00:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2020-04-28T13:00:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2020-04-28T13:00:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2020-04-28T13:00:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2020-04-28T13:00:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2020-04-28T13:00:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2020-04-28T13:00:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2020-04-28T13:00:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2020-04-28T13:00:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2020-04-28T13:00:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2020-04-28T13:00:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2020-04-28T13:00:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2020-04-28T13:00:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2020-04-28T13:00:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2020-04-28T13:00:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2020-04-28T13:00:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2020-04-28T13:00:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2020-04-28T13:00:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2020-04-28T13:00:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2020-04-28T13:00:02.389 INFO:teuthology.orchestra.run.smithi176.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2020-04-28T13:00:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.672 INFO:teuthology.orchestra.run.smithi176.stdout:Welcome to Gradle 6.0.1! 2020-04-28T13:00:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.672 INFO:teuthology.orchestra.run.smithi176.stdout:Here are the highlights of this release: 2020-04-28T13:00:04.672 INFO:teuthology.orchestra.run.smithi176.stdout: - Substantial improvements in dependency management, including 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Advanced control of transitive versions 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Support for optional features and dependencies 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Rules to tweak published metadata 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Support for Java 13 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - Faster incremental Java and Groovy compilation 2020-04-28T13:00:04.673 INFO:teuthology.orchestra.run.smithi176.stdout: - New Zinc compiler for Scala 2020-04-28T13:00:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: - VS2019 support 2020-04-28T13:00:04.674 INFO:teuthology.orchestra.run.smithi176.stdout: - Support for Gradle Enterprise plugin 3.0 2020-04-28T13:00:04.677 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.677 INFO:teuthology.orchestra.run.smithi176.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2020-04-28T13:00:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.678 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.678 INFO:teuthology.orchestra.run.smithi176.stdout:------------------------------------------------------------ 2020-04-28T13:00:04.678 INFO:teuthology.orchestra.run.smithi176.stdout:Gradle 6.0.1 2020-04-28T13:00:04.678 INFO:teuthology.orchestra.run.smithi176.stdout:------------------------------------------------------------ 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout:Build time: 2019-11-18 20:25:01 UTC 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout:Kotlin: 1.3.50 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout:Groovy: 2.5.8 2020-04-28T13:00:04.679 INFO:teuthology.orchestra.run.smithi176.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2020-04-28T13:00:04.680 INFO:teuthology.orchestra.run.smithi176.stdout:JVM: 1.8.0_252 (Oracle Corporation 25.252-b09) 2020-04-28T13:00:04.680 INFO:teuthology.orchestra.run.smithi176.stdout:OS: Linux 4.18.0-147.8.1.el8_1.x86_64 amd64 2020-04-28T13:00:04.680 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:04.680 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2020-04-28T13:00:04.680 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T13:00:04.680 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi176.front.sepia.ceph.com 2020-04-28T13:00:04.681 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T13:00:04.681 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi084.front.sepia.ceph.com 2020-04-28T13:00:04.681 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2020-04-28T13:00:04.880 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2020-04-28T13:00:04.880 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2020-04-28T13:00:04.881 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'KNXMBFKMGTRYDPVLCTBL', 's3dir': 'folder', 'endpoint': 'smithi176.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': 'm2cK09NvTYPJgWCB/0kC2tFWfMiaaacwwxy0h4WQefHKTDYWU7f/Sw==', 'host': 'smithi176.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2020-04-28T13:00:04.881 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2020-04-28T13:00:04.881 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'KNXMBFKMGTRYDPVLCTBL', '--secret', 'm2cK09NvTYPJgWCB/0kC2tFWfMiaaacwwxy0h4WQefHKTDYWU7f/Sw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2020-04-28T13:00:04.881 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:04.895 INFO:teuthology.orchestra.run.smithi176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key KNXMBFKMGTRYDPVLCTBL --secret m2cK09NvTYPJgWCB/0kC2tFWfMiaaacwwxy0h4WQefHKTDYWU7f/Sw== --email tester.client.0_test@test.test --cluster ceph 2020-04-28T13:00:05.003 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.983+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.985+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.985+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.985+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.985+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.986+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.986+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.004 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:04.987+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.005 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T13:00:05.005 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T13:00:05.005 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T13:00:05.005 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T13:00:05.006 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.001+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.002+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.002+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.002+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.007 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.002+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.008 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.008 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.009 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.009 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T13:00:05.009 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.003+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.004+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.004+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.004+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.004+0000 7f43fb533180 20 zonegroup default 2020-04-28T13:00:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.004+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 10 Cannot find current period zone using local zone 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.011 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.005+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.012 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43fb533180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.012 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43e951c700 0 -- 172.21.15.176:0/3290334652 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7f43e4010c10 msgr2=0x7f43e4016910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43fb533180 20 zone default found 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.006+0000 7f43fb533180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.007+0000 7f43fb533180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.007+0000 7f43fb533180 20 started sync module instance, tier type = 2020-04-28T13:00:05.013 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.007+0000 7f43fb533180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T13:00:05.021 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=0 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=1 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=2 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=3 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=4 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=5 2020-04-28T13:00:05.022 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.017+0000 7f43fb533180 20 add_watcher() i=6 2020-04-28T13:00:05.023 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43fb533180 20 add_watcher() i=7 2020-04-28T13:00:05.023 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43fb533180 2 all 8 watchers are set, enabling cache 2020-04-28T13:00:05.023 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43fb533180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T13:00:05.024 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43fb533180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T13:00:05.024 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43b9fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:05.024 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.019+0000 7f43e951c700 0 -- 172.21.15.176:0/3263880290 >> v2:172.21.15.176:3300/0 conn(0x556f22f2b8f0 msgr2=0x556f22f2c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f432bfff700 20 reqs_thread_entry: start 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f4329ffb700 20 reqs_thread_entry: start 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f43fb533180 20 init_complete bucket index max shards: 1999 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f4317fff700 20 reqs_thread_entry: start 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f43fb533180 20 get_system_obj_state: rctx=0x7ffda5e81af8 obj=default.rgw.meta:users.uid:tester.client.0 state=0x556f22dd6170 s->prefetch_data=0 2020-04-28T13:00:05.073 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.068+0000 7f43fb533180 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 20 get_system_obj_state: rctx=0x7ffda5e81b08 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x556f22dd6170 s->prefetch_data=0 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2020-04-28T13:00:05.075 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 20 get_system_obj_state: rctx=0x7ffda5e81b08 obj=default.rgw.meta:users.keys:KNXMBFKMGTRYDPVLCTBL state=0x556f22dd6170 s->prefetch_data=0 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.069+0000 7f43fb533180 10 cache get: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL : miss 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL info.flags=0x0 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 adding default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL to cache LRU end 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 20 get_system_obj_state: rctx=0x7ffda5e81518 obj=default.rgw.meta:users.keys:KNXMBFKMGTRYDPVLCTBL state=0x556f22dd6170 s->prefetch_data=0 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 cache get: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL : type miss (requested=0x6, cached=0x0) 2020-04-28T13:00:05.076 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL info.flags=0x0 2020-04-28T13:00:05.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 moving default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL to cache LRU end 2020-04-28T13:00:05.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 20 get_system_obj_state: rctx=0x7ffda5e81808 obj=default.rgw.meta:users.keys:KNXMBFKMGTRYDPVLCTBL state=0x556f22dd6170 s->prefetch_data=0 2020-04-28T13:00:05.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.070+0000 7f43fb533180 10 cache get: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL : type miss (requested=0x6, cached=0x0) 2020-04-28T13:00:05.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.071+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL info.flags=0x0 2020-04-28T13:00:05.077 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.071+0000 7f43fb533180 10 moving default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL to cache LRU end 2020-04-28T13:00:05.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T13:00:05.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43fb533180 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T13:00:05.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43fb533180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2020-04-28T13:00:05.078 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43ca7fc700 10 RGWWatcher::handle_notify() notify_id 536870912008 cookie 93935816014160 notifier 4520 bl.length()=632 2020-04-28T13:00:05.079 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43ca7fc700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T13:00:05.079 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.072+0000 7f43ca7fc700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T13:00:05.079 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.074+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T13:00:05.080 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.074+0000 7f43fb533180 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T13:00:05.080 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.074+0000 7f43fb533180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2020-04-28T13:00:05.080 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.075+0000 7f43ca7fc700 10 RGWWatcher::handle_notify() notify_id 536870912006 cookie 93935816006656 notifier 4520 bl.length()=200 2020-04-28T13:00:05.080 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.075+0000 7f43ca7fc700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T13:00:05.080 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.075+0000 7f43ca7fc700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T13:00:05.081 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43fb533180 10 cache put: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL info.flags=0x7 2020-04-28T13:00:05.081 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43fb533180 10 moving default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL to cache LRU end 2020-04-28T13:00:05.081 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43fb533180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=189 2020-04-28T13:00:05.082 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43ca7fc700 10 RGWWatcher::handle_notify() notify_id 536870912014 cookie 93935816011888 notifier 4520 bl.length()=189 2020-04-28T13:00:05.082 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43ca7fc700 10 cache put: name=default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL info.flags=0x7 2020-04-28T13:00:05.082 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.077+0000 7f43ca7fc700 10 moving default.rgw.meta+users.keys+KNXMBFKMGTRYDPVLCTBL to cache LRU end 2020-04-28T13:00:05.082 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.078+0000 7f43b9fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout: "user_id": "tester.client.0", 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout: "display_name": "Ms. tester.client.0", 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout: "email": "tester.client.0_test@test.test", 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout: "suspended": 0, 2020-04-28T13:00:05.083 INFO:teuthology.orchestra.run.smithi176.stdout: "max_buckets": 1000, 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: "subusers": [], 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: "keys": [ 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: "user": "tester.client.0", 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: "access_key": "KNXMBFKMGTRYDPVLCTBL", 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: "secret_key": "m2cK09NvTYPJgWCB/0kC2tFWfMiaaacwwxy0h4WQefHKTDYWU7f/Sw==" 2020-04-28T13:00:05.084 INFO:teuthology.orchestra.run.smithi176.stdout: } 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "swift_keys": [], 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "caps": [], 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "op_mask": "read, write, delete", 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "default_placement": "", 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "default_storage_class": "", 2020-04-28T13:00:05.085 INFO:teuthology.orchestra.run.smithi176.stdout: "placement_tags": [], 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "bucket_quota": { 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T13:00:05.086 INFO:teuthology.orchestra.run.smithi176.stdout: "user_quota": { 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "enabled": false, 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "check_on_raw": false, 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size": -1, 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "max_size_kb": 0, 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "max_objects": -1 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2020-04-28T13:00:05.087 INFO:teuthology.orchestra.run.smithi176.stdout: "temp_url_keys": [], 2020-04-28T13:00:05.088 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "rgw", 2020-04-28T13:00:05.088 INFO:teuthology.orchestra.run.smithi176.stdout: "mfa_ids": [] 2020-04-28T13:00:05.088 INFO:teuthology.orchestra.run.smithi176.stdout:} 2020-04-28T13:00:05.088 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:05.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.079+0000 7f43fb533180 20 remove_watcher() i=0 2020-04-28T13:00:05.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.079+0000 7f43fb533180 2 removed watcher, disabling cache 2020-04-28T13:00:05.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.081+0000 7f43fb533180 20 remove_watcher() i=1 2020-04-28T13:00:05.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.082+0000 7f43fb533180 20 remove_watcher() i=2 2020-04-28T13:00:05.089 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.083+0000 7f43fb533180 20 remove_watcher() i=3 2020-04-28T13:00:05.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.084+0000 7f43fb533180 20 remove_watcher() i=4 2020-04-28T13:00:05.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.085+0000 7f43fb533180 20 remove_watcher() i=5 2020-04-28T13:00:05.090 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.086+0000 7f43fb533180 20 remove_watcher() i=6 2020-04-28T13:00:05.092 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.088+0000 7f43fb533180 20 remove_watcher() i=7 2020-04-28T13:00:05.097 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:05.112 INFO:teuthology.orchestra.run.smithi176:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2020-04-28T13:00:05.201 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2020-04-28T13:00:05.203 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:05.250 INFO:teuthology.orchestra.run.smithi176:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2020-04-28T13:00:05.304 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:05.357 INFO:teuthology.orchestra.run.smithi176:> radosgw-admin gc process --include-all 2020-04-28T13:00:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.430+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.433+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.433+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.433+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.437 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.433+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.438 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.434+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.438 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.434+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.439 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.435+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.452 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.448+0000 7fb44ba9b180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T13:00:05.452 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.448+0000 7fb44ba9b180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T13:00:05.453 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.448+0000 7fb44ba9b180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T13:00:05.453 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.448+0000 7fb44ba9b180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T13:00:05.453 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.448+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.454 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.454 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.454 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.455 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.455 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.455 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.449+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.455 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.450+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.455 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.450+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.457 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.450+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.457 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.450+0000 7fb44ba9b180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T13:00:05.457 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.450+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 zonegroup default 2020-04-28T13:00:05.458 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.451+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 10 Cannot find current period zone using local zone 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.459 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.452+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 zone default found 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.460 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 started sync module instance, tier type = 2020-04-28T13:00:05.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.453+0000 7fb44ba9b180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T13:00:05.461 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.456+0000 7fb439a84700 0 -- 172.21.15.176:0/1117900523 >> [v2:172.21.15.176:6802/23287,v1:172.21.15.176:6803/23287] conn(0x7fb43003f230 msgr2=0x7fb43003eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T13:00:05.468 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=0 2020-04-28T13:00:05.468 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=1 2020-04-28T13:00:05.468 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=2 2020-04-28T13:00:05.469 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=3 2020-04-28T13:00:05.469 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=4 2020-04-28T13:00:05.469 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=5 2020-04-28T13:00:05.469 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.464+0000 7fb44ba9b180 20 add_watcher() i=6 2020-04-28T13:00:05.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.465+0000 7fb44ba9b180 20 add_watcher() i=7 2020-04-28T13:00:05.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.465+0000 7fb44ba9b180 2 all 8 watchers are set, enabling cache 2020-04-28T13:00:05.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.465+0000 7fb44ba9b180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T13:00:05.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.465+0000 7fb44ba9b180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T13:00:05.470 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.465+0000 7fb40a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:05.471 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.466+0000 7fb43a285700 0 -- 172.21.15.176:0/2903828486 >> v2:172.21.15.176:3300/0 conn(0x5616ba5aed40 msgr2=0x5616ba5725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T13:00:05.521 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.517+0000 7fb380ff9700 20 reqs_thread_entry: start 2020-04-28T13:00:05.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.517+0000 7fb37a7fc700 20 reqs_thread_entry: start 2020-04-28T13:00:05.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.517+0000 7fb44ba9b180 20 init_complete bucket index max shards: 1999 2020-04-28T13:00:05.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.517+0000 7fb378ff9700 20 reqs_thread_entry: start 2020-04-28T13:00:05.522 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.517+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T13:00:05.523 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.519+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.520+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.520+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.520+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.109', time=2020-04-28T14:59:39.939143+0000, chain.objs.size()=1 2020-04-28T13:00:05.524 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.520+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.oZcywW5vBNxt9AEJmag8BANbZ52x1f5_0 2020-04-28T13:00:05.526 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.522+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.528 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.524+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T13:00:05.529 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.526+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.532 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.526+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.527+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.533 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.528+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T13:00:05.534 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.530+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.535 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.531+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.532+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.532+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_1DbutjylAwhA5I0FN0bjpoi1XSBeKQn', time=2020-04-28T14:59:41.882674+0000, chain.objs.size()=2 2020-04-28T13:00:05.544 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.532+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.IbrJgUyHGgAj1X80UPa2KCuZWhvryuV_1 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.532+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.IbrJgUyHGgAj1X80UPa2KCuZWhvryuV_2 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.533+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.535+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.537+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.538+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.545 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.538+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.538+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_dpvqxpRmYxefhm_xMERNyjDQOEn1i7w', time=2020-04-28T14:59:41.894033+0000, chain.objs.size()=1 2020-04-28T13:00:05.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.538+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.vmAkPIpQgUQuKT0Jm10ngxI8aEhBVKE_0 2020-04-28T13:00:05.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.540+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.546 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.542+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T13:00:05.548 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.544+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.549 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.545+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.20', time=2020-04-28T14:59:32.518663+0000, chain.objs.size()=4 2020-04-28T13:00:05.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2__multipart_foo.2~wDtCPeHkdmVLm3JlDkgbNchsXUKaM0n.1 2020-04-28T13:00:05.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2__multipart_foo.2~wDtCPeHkdmVLm3JlDkgbNchsXUKaM0n.2 2020-04-28T13:00:05.550 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2__multipart_foo.2~wDtCPeHkdmVLm3JlDkgbNchsXUKaM0n.3 2020-04-28T13:00:05.551 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.546+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.2__multipart_foo.2~wDtCPeHkdmVLm3JlDkgbNchsXUKaM0n.4 2020-04-28T13:00:05.552 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.548+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.567 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.550+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.552+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.553+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.553+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.554+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.556+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.568 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.557+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.570 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T13:00:05.570 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.119', time=2020-04-28T14:59:39.916620+0000, chain.objs.size()=1 2020-04-28T13:00:05.570 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.sJDZ9GLunJopnZVDsb67-p-DZkxQrgC_1 2020-04-28T13:00:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.225', time=2020-04-28T14:59:41.888573+0000, chain.objs.size()=3 2020-04-28T13:00:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.1 2020-04-28T13:00:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.2 2020-04-28T13:00:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.558+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.3 2020-04-28T13:00:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.560+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.563+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T13:00:05.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.565+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.566+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.572 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.566+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.573 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.566+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_ZKgpv67ysshHRaMpQMljLb2ZyFqaZeN', time=2020-04-28T14:59:39.899551+0000, chain.objs.size()=1 2020-04-28T13:00:05.573 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.566+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.TViw2-Nnl5Id_-IHOtYZu0fMcQR2oT__0 2020-04-28T13:00:05.573 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.568+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.579 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.570+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T13:00:05.579 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.572+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.579 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.573+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.580 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.573+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.580 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.575+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T13:00:05.581 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.576+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.581 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.577+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.582 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.578+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.583 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.579+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T13:00:05.585 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.581+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.586 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.582+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.211', time=2020-04-28T14:59:43.741411+0000, chain.objs.size()=3 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-STANDARD.2~JGHTvxoFIK3mKrd8jj2Q4zneId4uhab.1 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-STANDARD.2~JGHTvxoFIK3mKrd8jj2Q4zneId4uhab.2 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-STANDARD.2~JGHTvxoFIK3mKrd8jj2Q4zneId4uhab.3 2020-04-28T13:00:05.588 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.86', time=2020-04-28T14:59:45.737751+0000, chain.objs.size()=1 2020-04-28T13:00:05.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.583+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6__shadow_.SrtSQn-HpcmGOxhE2k9S3LldsKQEcrF_1 2020-04-28T13:00:05.589 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.586+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.592 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.588+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T13:00:05.593 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.589+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.594 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.590+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.595 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T13:00:05.595 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.40', time=2020-04-28T14:59:34.304379+0000, chain.objs.size()=4 2020-04-28T13:00:05.595 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3__multipart_foo.2~uyXYAJd3zWTESqoaIFHOly1R6oOtx39.1 2020-04-28T13:00:05.595 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3__multipart_foo.2~uyXYAJd3zWTESqoaIFHOly1R6oOtx39.2 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3__multipart_foo.2~uyXYAJd3zWTESqoaIFHOly1R6oOtx39.3 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.3__multipart_foo.2~uyXYAJd3zWTESqoaIFHOly1R6oOtx39.4 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_NJkWtgaI1s5ncdTpG6gvI625Rpa_lpd', time=2020-04-28T14:59:39.905228+0000, chain.objs.size()=1 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.R_sWTG-M8V7kdfPYCMNwijiLC350cs2_0 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_AgNgNzZ4b2EoZJWRyLLay8LEpdrJjVJ', time=2020-04-28T14:59:41.900653+0000, chain.objs.size()=2 2020-04-28T13:00:05.596 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.uyfKnGb8bm5dXzWa9se-Yg9md4kEOhM_0 2020-04-28T13:00:05.597 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.591+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.uyfKnGb8bm5dXzWa9se-Yg9md4kEOhM_1 2020-04-28T13:00:05.597 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.593+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.600 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.596+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T13:00:05.601 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.598+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.602 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.598+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.603 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.599+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.604 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.600+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T13:00:05.605 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.601+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.606 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.602+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.607 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.603+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.607 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.603+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.243', time=2020-04-28T14:59:41.923076+0000, chain.objs.size()=3 2020-04-28T13:00:05.607 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.603+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.1 2020-04-28T13:00:05.607 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.603+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.2 2020-04-28T13:00:05.608 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.603+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.3 2020-04-28T13:00:05.608 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.604+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.610 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.606+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T13:00:05.621 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.608+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.621 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.609+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.621 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.610+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.610+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_uVCh1kmLU0LeqUnrm5TH1a78WHPoIBU', time=2020-04-28T14:59:41.928157+0000, chain.objs.size()=1 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.610+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.PM3Zt0bp_fmvTHR17AcH542y5Uye210_0 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.611+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.614+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.616+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.622 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.616+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.617+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.617+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.84', time=2020-04-28T14:59:45.731611+0000, chain.objs.size()=2 2020-04-28T13:00:05.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.617+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6__shadow_.BE2gEqRXPreVM_E79AfXevvEdTQoWCi_0 2020-04-28T13:00:05.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.617+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6__shadow_.BE2gEqRXPreVM_E79AfXevvEdTQoWCi_1 2020-04-28T13:00:05.623 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.618+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.625 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.621+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T13:00:05.627 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.623+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.624+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.628 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.625+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.630 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.626+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T13:00:05.632 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.628+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.633 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.629+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.634 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.630+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.635 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.631+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T13:00:05.638 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.634+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.639 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.635+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.639 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.635+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.639 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.635+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_oqaeR__Al_yFTgmc4qC8xIte7JL4hj5', time=2020-04-28T14:59:41.906416+0000, chain.objs.size()=2 2020-04-28T13:00:05.640 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.635+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.xb0dF9-2TsBauFsTFDMNL3UsyRu-j9a_1 2020-04-28T13:00:05.640 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.635+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.xb0dF9-2TsBauFsTFDMNL3UsyRu-j9a_2 2020-04-28T13:00:05.640 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.637+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.643 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.639+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T13:00:05.647 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.641+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.647 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.641+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.648 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.642+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.648 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.643+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T13:00:05.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.645+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.649 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.651 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.651 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.204', time=2020-04-28T14:59:43.730091+0000, chain.objs.size()=3 2020-04-28T13:00:05.651 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-LUKEWARM.2~Rq1iHF3A6qlO5zhrS_45ImnJh4GJXde.1 2020-04-28T13:00:05.652 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-LUKEWARM.2~Rq1iHF3A6qlO5zhrS_45ImnJh4GJXde.2 2020-04-28T13:00:05.652 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.646+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-LUKEWARM.2~Rq1iHF3A6qlO5zhrS_45ImnJh4GJXde.3 2020-04-28T13:00:05.653 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.648+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.655 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.651+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T13:00:05.656 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.652+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.657 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.653+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.658 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.654+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.658 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.654+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.108', time=2020-04-28T14:59:39.894242+0000, chain.objs.size()=1 2020-04-28T13:00:05.658 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.654+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.oZcywW5vBNxt9AEJmag8BANbZ52x1f5_0 2020-04-28T13:00:05.659 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.655+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.661 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.657+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T13:00:05.663 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.659+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.664 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.665 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T13:00:05.665 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.116', time=2020-04-28T14:59:39.928300+0000, chain.objs.size()=1 2020-04-28T13:00:05.665 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.sJDZ9GLunJopnZVDsb67-p-DZkxQrgC_1 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_LEr91Ez-gZ6IHh9yCc4HXS7gaZ-K8im', time=2020-04-28T14:59:39.933890+0000, chain.objs.size()=1 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.mKyPhEKVoctF6CbADGHKwWtTw7_iXJW_0 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.226', time=2020-04-28T14:59:41.933388+0000, chain.objs.size()=3 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.1 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.2 2020-04-28T13:00:05.666 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.660+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-FROZEN.2~-XZxQ0klw_utjmtq0pLT1e7lU5ziIHa.3 2020-04-28T13:00:05.667 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.663+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.670 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.666+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T13:00:05.672 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.668+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.672 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.668+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.673 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T13:00:05.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.55', time=2020-04-28T14:59:36.244790+0000, chain.objs.size()=4 2020-04-28T13:00:05.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4__multipart_foo.2~mN3mGFvY9BUQO2J7fyJE0UXVzG-tDAy.1 2020-04-28T13:00:05.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4__multipart_foo.2~mN3mGFvY9BUQO2J7fyJE0UXVzG-tDAy.2 2020-04-28T13:00:05.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4__multipart_foo.2~mN3mGFvY9BUQO2J7fyJE0UXVzG-tDAy.3 2020-04-28T13:00:05.674 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.4__multipart_foo.2~mN3mGFvY9BUQO2J7fyJE0UXVzG-tDAy.4 2020-04-28T13:00:05.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_2obC2cb6mOSoZ4cG9axordWte1WC5J5', time=2020-04-28T14:59:39.888611+0000, chain.objs.size()=1 2020-04-28T13:00:05.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.9xWzetKALmiSuOJiWm5PTk5L5FjZBmL_1 2020-04-28T13:00:05.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.236', time=2020-04-28T14:59:41.877169+0000, chain.objs.size()=3 2020-04-28T13:00:05.675 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.1 2020-04-28T13:00:05.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.2 2020-04-28T13:00:05.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.669+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.3 2020-04-28T13:00:05.676 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.672+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.678 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.674+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T13:00:05.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.676+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.680 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.676+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.681 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.677+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.682 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.678+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T13:00:05.683 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.680+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.684 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.680+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.681+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.681+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_Lxq1lMAADh_IQNsbC9t_K5ehuueBaOF', time=2020-04-28T14:59:41.917806+0000, chain.objs.size()=2 2020-04-28T13:00:05.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.681+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.R1jssi9VoOkRMNQWXueEtuVZWcbDaxv_0 2020-04-28T13:00:05.685 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.681+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__shadow_.R1jssi9VoOkRMNQWXueEtuVZWcbDaxv_1 2020-04-28T13:00:05.686 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.682+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.689 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.685+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T13:00:05.691 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.687+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.692 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.688+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_kPH8IHJoQRCeNXfBZquaEi88EP9qaI6', time=2020-04-28T14:59:39.910979+0000, chain.objs.size()=1 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.kftmVEC_mVwZNGBlwmcZC1mH2uiYt-R_1 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='_aw53tQZ8uP1h-pmJJkLoOnH4ABE5A1Y', time=2020-04-28T14:59:39.922887+0000, chain.objs.size()=1 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.P8-Kp_-vHUW2Ae_QvA598OS1I5xKtbD_0 2020-04-28T13:00:05.693 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.85', time=2020-04-28T14:59:45.726042+0000, chain.objs.size()=2 2020-04-28T13:00:05.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6__shadow_.x2t3jNa3OfDoTUYqmCTPqgkuhXTSQdl_0 2020-04-28T13:00:05.694 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.689+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.6__shadow_.x2t3jNa3OfDoTUYqmCTPqgkuhXTSQdl_1 2020-04-28T13:00:05.696 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.692+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.698 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.694+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T13:00:05.700 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.696+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.701 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.701 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T13:00:05.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.112', time=2020-04-28T14:59:39.877849+0000, chain.objs.size()=1 2020-04-28T13:00:05.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.izzKrxvlWY8fSgBL07TuX_FjpLPB69g_0 2020-04-28T13:00:05.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.114', time=2020-04-28T14:59:39.883366+0000, chain.objs.size()=1 2020-04-28T13:00:05.702 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.697+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.7__shadow_.izzKrxvlWY8fSgBL07TuX_FjpLPB69g_0 2020-04-28T13:00:05.703 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.700+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.706 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.702+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T13:00:05.708 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.704+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.709 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.705+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.710 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.706+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.710 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.706+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.234', time=2020-04-28T14:59:41.871903+0000, chain.objs.size()=3 2020-04-28T13:00:05.710 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.706+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.1 2020-04-28T13:00:05.710 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.706+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.2 2020-04-28T13:00:05.710 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.706+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-LUKEWARM.2~90FQ6c_DS9q4zN50R5Btd84bBJ6bj3F.3 2020-04-28T13:00:05.711 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.707+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.713 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.710+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T13:00:05.715 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.711+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.716 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T13:00:05.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.246', time=2020-04-28T14:59:41.912145+0000, chain.objs.size()=3 2020-04-28T13:00:05.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.1 2020-04-28T13:00:05.717 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.2 2020-04-28T13:00:05.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.9__multipart_foo-STANDARD.2~PK8lPAAVeIK-7OIMxRWJ_k4O_xtDbU5.3 2020-04-28T13:00:05.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.197', time=2020-04-28T14:59:43.735705+0000, chain.objs.size()=3 2020-04-28T13:00:05.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-FROZEN.2~1_2SnSUezD7lCLtzOb1GCjzWq40Wk_2.1 2020-04-28T13:00:05.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-FROZEN.2~1_2SnSUezD7lCLtzOb1GCjzWq40Wk_2.2 2020-04-28T13:00:05.718 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.712+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.8__multipart_foo-FROZEN.2~1_2SnSUezD7lCLtzOb1GCjzWq40Wk_2.3 2020-04-28T13:00:05.719 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.715+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.721 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.717+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T13:00:05.723 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.719+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.723 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.719+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T13:00:05.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 20 garbage collection: RGWGC::process iterating over entry tag='5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4361.71', time=2020-04-28T14:59:38.070751+0000, chain.objs.size()=4 2020-04-28T13:00:05.724 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5__multipart_foo.2~tK65fASq-EsMi0RQ7TCykzU7EnPJdTI.1 2020-04-28T13:00:05.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5__multipart_foo.2~tK65fASq-EsMi0RQ7TCykzU7EnPJdTI.2 2020-04-28T13:00:05.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5__multipart_foo.2~tK65fASq-EsMi0RQ7TCykzU7EnPJdTI.3 2020-04-28T13:00:05.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.720+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5b3cbaf2-006a-4392-bd49-a3107d3aaf6a.4367.5__multipart_foo.2~tK65fASq-EsMi0RQ7TCykzU7EnPJdTI.4 2020-04-28T13:00:05.725 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.722+0000 7fb44ba9b180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T13:00:05.728 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.724+0000 7fb44ba9b180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T13:00:05.729 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.726+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.730 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.726+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:05.731 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.727+0000 7fb44ba9b180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:05.732 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.728+0000 7fb40a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:05.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.729+0000 7fb44ba9b180 20 remove_watcher() i=0 2020-04-28T13:00:05.733 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.729+0000 7fb44ba9b180 2 removed watcher, disabling cache 2020-04-28T13:00:05.735 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.731+0000 7fb44ba9b180 20 remove_watcher() i=1 2020-04-28T13:00:05.737 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.733+0000 7fb44ba9b180 20 remove_watcher() i=2 2020-04-28T13:00:05.738 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.734+0000 7fb44ba9b180 20 remove_watcher() i=3 2020-04-28T13:00:05.739 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.735+0000 7fb44ba9b180 20 remove_watcher() i=4 2020-04-28T13:00:05.740 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.736+0000 7fb44ba9b180 20 remove_watcher() i=5 2020-04-28T13:00:05.741 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.738+0000 7fb44ba9b180 20 remove_watcher() i=6 2020-04-28T13:00:05.743 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.739+0000 7fb44ba9b180 20 remove_watcher() i=7 2020-04-28T13:00:05.747 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:05.801 INFO:teuthology.orchestra.run.smithi176:> radosgw-admin gc process --include-all 2020-04-28T13:00:05.879 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.875+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.881 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.877+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.882 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.877+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.878+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.878+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.878+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.878+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.883 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.879+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.897 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.893+0000 7efd1870c180 20 RGWRados::pool_iterate: got zonegroup_info.c5382ea5-8b50-4ba6-91a2-2a1dc3030eb0 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.893+0000 7efd1870c180 20 RGWRados::pool_iterate: got zone_info.5b3cbaf2-006a-4392-bd49-a3107d3aaf6a 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.893+0000 7efd1870c180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.893+0000 7efd1870c180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.893+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.898 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.900 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.894+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.901 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.902 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.895+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.902 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.896+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.902 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.896+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.903 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.896+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.896+0000 7efd1870c180 20 zonegroup default 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.896+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 10 Cannot find current period zone using local zone 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.904 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T13:00:05.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.897+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T13:00:05.905 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 zone default found 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 rados->read ofs=0 len=0 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 started sync module instance, tier type = 2020-04-28T13:00:05.906 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.898+0000 7efd1870c180 20 started zone id=5b3cbaf2-006a-4392-bd49-a3107d3aaf6a (name=default) with tier type = 2020-04-28T13:00:05.907 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.902+0000 7efd066f5700 0 -- 172.21.15.176:0/4158783378 >> [v2:172.21.15.176:6826/23657,v1:172.21.15.176:6827/23657] conn(0x7efd0003e5c0 msgr2=0x7efd0003e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=0 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=1 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=2 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=3 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=4 2020-04-28T13:00:05.913 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=5 2020-04-28T13:00:05.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.909+0000 7efd1870c180 20 add_watcher() i=6 2020-04-28T13:00:05.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.910+0000 7efd1870c180 20 add_watcher() i=7 2020-04-28T13:00:05.914 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.910+0000 7efd1870c180 2 all 8 watchers are set, enabling cache 2020-04-28T13:00:05.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.910+0000 7efd1870c180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T13:00:05.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.910+0000 7efd1870c180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T13:00:05.915 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.910+0000 7efcd6fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:05.916 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:05.912+0000 7efd05ef4700 0 -- 172.21.15.176:0/2541232313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559e326792e0 msgr2=0x559e326848c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T13:00:06.117 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.113+0000 7efd05ef4700 0 --2- 172.21.15.176:0/2541232313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559e326792e0 0x559e326848c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-28T13:00:06.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.161+0000 7efc457fa700 20 reqs_thread_entry: start 2020-04-28T13:00:06.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.161+0000 7efd1870c180 20 init_complete bucket index max shards: 1999 2020-04-28T13:00:06.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.161+0000 7efc437f6700 20 reqs_thread_entry: start 2020-04-28T13:00:06.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.162+0000 7efc41ff3700 20 reqs_thread_entry: start 2020-04-28T13:00:06.166 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.162+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T13:00:06.167 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.164+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.169 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.165+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.169 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.165+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.171 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.167+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T13:00:06.172 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.168+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.173 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.169+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.174 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.169+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.174 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.170+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T13:00:06.177 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.173+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.177 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.174+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.178 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.174+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.179 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.175+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T13:00:06.181 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.177+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.181 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.178+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.182 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.178+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.183 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.180+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T13:00:06.207 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.181+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.207 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.182+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.207 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.182+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.207 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.183+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.185+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.186+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.187+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.188+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.190+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.208 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.191+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.191+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.192+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.194+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.195+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.195+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.197+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T13:00:06.209 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.199+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.210 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.200+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.210 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.200+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.210 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.202+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T13:00:06.211 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.203+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.211 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.204+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.211 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.205+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.212 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.206+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T13:00:06.212 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.208+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.212 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.209+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.213 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.209+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.217 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.210+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T13:00:06.217 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.212+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.217 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.213+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.218 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.214+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.222 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.215+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T13:00:06.222 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.216+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.222 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.217+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.222 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.217+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.223 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.219+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T13:00:06.224 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.220+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.225 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.221+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.225 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.221+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.227 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.223+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T13:00:06.229 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.225+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.230 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.226+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.230 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.226+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.231 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.228+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T13:00:06.233 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.229+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.234 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.230+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.235 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.231+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.236 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.232+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T13:00:06.238 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.234+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.239 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.235+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.240 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.236+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.241 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.237+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T13:00:06.242 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.239+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.243 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.240+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.244 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.240+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.245 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.241+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T13:00:06.247 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.243+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.244+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.248 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.245+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.250 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.246+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T13:00:06.251 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.248+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.252 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.248+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.253 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.249+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.254 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.250+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T13:00:06.256 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.252+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.257 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.253+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.257 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.253+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.259 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.255+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T13:00:06.260 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.256+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.257+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.261 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.257+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.262 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.258+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T13:00:06.264 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.260+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.265 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.261+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.266 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.262+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.267 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.263+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T13:00:06.269 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.265+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.266+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.270 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.266+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.271 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.267+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T13:00:06.273 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.269+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.273 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.270+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.274 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.270+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.275 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.271+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T13:00:06.277 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.273+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.277 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.273+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.278 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.274+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.279 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.275+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T13:00:06.281 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.277+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.282 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.278+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.283 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.279+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.284 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.280+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T13:00:06.286 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.282+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.287 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.283+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.287 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.283+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.289 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.285+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T13:00:06.290 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.287+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.292 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.288+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.292 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.288+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.294 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.290+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T13:00:06.295 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.292+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.296 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.292+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.297 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.293+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.298 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.294+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T13:00:06.300 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.296+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.297+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.301 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.297+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.302 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.298+0000 7efd1870c180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T13:00:06.304 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.300+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.305 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.301+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T13:00:06.305 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.301+0000 7efd1870c180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T13:00:06.306 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.303+0000 7efcd6fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T13:00:06.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.304+0000 7efd1870c180 20 remove_watcher() i=0 2020-04-28T13:00:06.308 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.304+0000 7efd1870c180 2 removed watcher, disabling cache 2020-04-28T13:00:06.309 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.305+0000 7efd1870c180 20 remove_watcher() i=1 2020-04-28T13:00:06.311 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.307+0000 7efd1870c180 20 remove_watcher() i=2 2020-04-28T13:00:06.312 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.308+0000 7efd1870c180 20 remove_watcher() i=3 2020-04-28T13:00:06.313 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.309+0000 7efd1870c180 20 remove_watcher() i=4 2020-04-28T13:00:06.314 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.310+0000 7efd1870c180 20 remove_watcher() i=5 2020-04-28T13:00:06.315 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.311+0000 7efd1870c180 20 remove_watcher() i=6 2020-04-28T13:00:06.317 INFO:teuthology.orchestra.run.smithi176.stderr:2020-04-28T13:00:06.313+0000 7efd1870c180 20 remove_watcher() i=7 2020-04-28T13:00:06.321 INFO:teuthology.orchestra.run.smithi176:> true 2020-04-28T13:00:06.374 INFO:teuthology.orchestra.run.smithi176:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2020-04-28T13:00:06.867 INFO:teuthology.orchestra.run.smithi176.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2020-04-28T13:00:10.968 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :clean UP-TO-DATE 2020-04-28T13:00:28.067 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :compileJava 2020-04-28T13:00:28.167 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :processResources 2020-04-28T13:00:28.167 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :classes 2020-04-28T13:00:28.775 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:28.776 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :compileTestJava 2020-04-28T13:00:28.776 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:28.776 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :processTestResources NO-SOURCE 2020-04-28T13:00:28.776 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :testClasses 2020-04-28T13:00:28.776 INFO:teuthology.orchestra.run.smithi176.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2020-04-28T13:00:28.777 INFO:teuthology.orchestra.run.smithi176.stderr:Note: Recompile with -Xlint:deprecation for details. 2020-04-28T13:00:34.568 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:34.568 INFO:teuthology.orchestra.run.smithi176.stdout:> Task :test 2020-04-28T13:00:34.568 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:34.568 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2020-04-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:35.967 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2020-04-28T13:00:37.967 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:37.967 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2020-04-28T13:00:38.467 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:38.467 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2020-04-28T13:00:40.467 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:40.467 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2020-04-28T13:00:41.367 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:41.367 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2020-04-28T13:00:43.967 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:43.968 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T13:00:43.968 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:43.968 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T13:00:44.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:44.067 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2020-04-28T13:00:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:44.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2020-04-28T13:00:46.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:46.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2020-04-28T13:00:47.767 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:47.767 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2020-04-28T13:00:51.767 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:51.767 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2020-04-28T13:00:57.767 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:00:57.767 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2020-04-28T13:01:02.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:02.167 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2020-04-28T13:01:02.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:02.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2020-04-28T13:01:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:04.867 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2020-04-28T13:01:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:05.667 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2020-04-28T13:01:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:10.167 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2020-04-28T13:01:11.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:11.167 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2020-04-28T13:01:13.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:13.167 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T13:01:13.267 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:13.267 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T13:01:13.367 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:13.367 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2020-04-28T13:01:16.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:16.067 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2020-04-28T13:01:18.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:18.067 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2020-04-28T13:01:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:18.967 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2020-04-28T13:01:21.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:21.067 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2020-04-28T13:01:21.867 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:21.867 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2020-04-28T13:01:23.867 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:23.867 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2020-04-28T13:01:30.668 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:30.668 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2020-04-28T13:01:32.967 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:32.967 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2020-04-28T13:01:34.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:34.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2020-04-28T13:01:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:36.667 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2020-04-28T13:01:37.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:37.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2020-04-28T13:01:39.567 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:39.567 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2020-04-28T13:01:40.370 INFO:teuthology.orchestra.run.smithi176.stdout: 2020-04-28T13:01:40.370 INFO:teuthology.orchestra.run.smithi176.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2020-04-28T13:05:04.812 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:05:04.802+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:06:03.966 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:06:03.962+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T13:07:50.735 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:07:50.732+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:10:23.468 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:10:23.464+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:11:25.468 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:11:25.464+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:13:57.957 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T13:13:57.954+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T13:19:08.295 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:19:08.293+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:21:01.919 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:21:01.917+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T13:21:02.157 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:21:02.155+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:22:04.217 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:22:04.215+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T13:22:21.879 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T13:22:21.877+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T13:23:32.971 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:23:32.970+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:23:54.593 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:23:54.592+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T13:24:21.934 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:24:21.932+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:28:10.833 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:28:10.831+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T13:28:10.833 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:28:10.831+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T13:28:26.719 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:28:26.716+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T13:28:26.719 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:28:26.717+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T13:30:53.384 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T13:30:53.384+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T13:34:00.836 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:34:00.834+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:34:07.825 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:34:07.823+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:43:43.688 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T13:43:43.686+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T13:49:07.617 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:49:07.614+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T13:49:27.221 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:49:27.218+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T13:49:27.221 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:49:27.218+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T13:50:11.469 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T13:50:11.461+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T13:50:58.749 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:50:58.748+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T13:50:58.750 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T13:50:58.749+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T13:56:50.320 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T13:56:50.318+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:02:39.006 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:02:39.005+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T14:02:39.007 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:02:39.005+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T14:02:39.007 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:02:39.005+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T14:05:23.334 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:05:23.332+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T14:09:15.531 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:09:15.531+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:10:16.937 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:10:16.937+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T14:10:16.937 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:10:16.937+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T14:10:16.937 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T14:10:16.937+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T14:11:08.553 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:11:08.553+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T14:11:08.553 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:11:08.553+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:12:56.608 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:12:56.608+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:16:29.415 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:16:29.413+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:17:26.919 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:17:26.918+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:19:08.698 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:19:08.697+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:20:47.365 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:20:47.363+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:20:49.626 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:20:49.625+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T14:20:49.626 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:20:49.625+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:20:50.824 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:20:50.820+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:25:29.721 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:25:29.720+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:28:29.178 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:28:29.176+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:30:42.277 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:30:42.259+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:33:36.879 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:33:36.878+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:34:03.910 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:34:03.910+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:37:13.633 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T14:37:13.630+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T14:42:30.572 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:42:30.570+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:42:45.083 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:42:45.081+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T14:48:01.168 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:48:01.165+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T14:48:01.169 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:48:01.166+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:49:23.086 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T14:49:23.084+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T14:50:00.723 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T14:50:00.718+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T14:56:52.658 INFO:tasks.ceph.osd.0.smithi176.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2020-04-28T14:56:52.659 INFO:tasks.ceph.osd.2.smithi176.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2020-04-28T14:56:52.659 INFO:tasks.ceph.osd.1.smithi176.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2020-04-28T14:56:52.659 INFO:tasks.ceph.osd.3.smithi176.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2020-04-28T14:56:52.749 INFO:tasks.ceph.mon.c.smithi176.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2020-04-28T14:56:52.749 INFO:tasks.ceph.mon.a.smithi176.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2020-04-28T14:56:52.751 INFO:tasks.ceph.mgr.y.smithi176.stderr:problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2020-04-28T14:56:52.873 INFO:tasks.rgw.client.0.smithi176.stdout:problem writing to /var/log/ceph/rgw.ceph.client.0.log: tee: /var/log/ceph/rgw.ceph.client.0.stdout: No space left on device 2020-04-28T14:56:52.874 INFO:tasks.rgw.client.0.smithi176.stdout:(28) No space left on device 2020-04-28T14:57:59.823 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T14:57:59.820+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T15:02:04.868 INFO:tasks.ceph.osd.4.smithi084.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2020-04-28T15:02:04.868 INFO:tasks.ceph.osd.5.smithi084.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2020-04-28T15:02:04.874 INFO:tasks.ceph.osd.6.smithi084.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2020-04-28T15:02:04.875 INFO:tasks.ceph.osd.7.smithi084.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2020-04-28T15:02:04.966 INFO:tasks.ceph.mon.b.smithi084.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2020-04-28T15:02:07.055 INFO:tasks.ceph.mgr.x.smithi084.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2020-04-28T15:05:25.524 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T15:05:25.521+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T15:12:36.760 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T15:12:36.757+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T15:21:25.704 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T15:21:25.702+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T15:23:43.470 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T15:23:43.467+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T15:23:43.470 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T15:23:43.467+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T15:29:16.756 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T15:29:16.753+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T15:30:12.383 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T15:30:12.381+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T15:30:46.544 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T15:30:46.543+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T15:32:05.613 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T15:32:05.610+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T15:32:05.614 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T15:32:05.610+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T15:32:05.614 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T15:32:05.610+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T15:33:48.470 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T15:33:48.467+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T15:46:09.824 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T15:46:09.818+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T15:56:21.986 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T15:56:21.983+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T15:59:57.914 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T15:59:57.912+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:02:01.583 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T16:02:01.581+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T16:02:01.583 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T16:02:01.581+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T16:02:01.583 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T16:02:01.581+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T16:02:16.047 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:02:16.044+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:02:16.047 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:02:16.044+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:07:12.330 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:07:12.327+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T16:07:43.147 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T16:07:43.145+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T16:09:43.794 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T16:09:43.791+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T16:10:28.823 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:10:28.820+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T16:16:09.518 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:16:09.514+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:16:09.518 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:16:09.514+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:19:18.099 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:19:18.096+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:19:18.100 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:19:18.096+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:19:35.118 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:19:35.116+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:22:13.037 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:22:13.034+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T16:32:09.768 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:32:09.761+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T16:33:37.278 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:33:37.273+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:39:58.323 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:39:58.320+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:39:58.347 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:39:58.320+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:39:59.274 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:39:59.270+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T16:39:59.275 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T16:39:59.270+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T16:40:00.339 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:40:00.337+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T16:40:30.856 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T16:40:30.848+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:01:25.496 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T17:01:25.492+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T17:07:28.503 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T17:07:28.500+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T17:12:21.455 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:12:21.453+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:13:54.894 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T17:13:54.891+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T17:16:29.866 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T17:16:29.864+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T17:20:50.634 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T17:20:50.630+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T17:21:15.818 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T17:21:15.816+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T17:28:33.888 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T17:28:33.887+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T17:36:45.467 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:36:45.465+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:42:01.297 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:42:01.296+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:42:07.876 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:42:07.876+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:45:46.308 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T17:45:46.306+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T17:45:46.308 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T17:45:46.306+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T17:51:30.674 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T17:51:30.671+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T17:52:27.078 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:52:27.075+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T17:53:56.620 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T17:53:56.618+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:02:15.385 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:02:15.382+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:05:36.661 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:05:36.658+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T18:07:55.012 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:07:55.007+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:08:14.251 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T18:08:14.250+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T18:10:50.437 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:10:50.436+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:13:25.677 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:13:25.675+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:14:58.106 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T18:14:58.105+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T18:15:59.272 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:15:59.269+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:17:36.713 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:17:36.711+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T18:17:36.713 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:17:36.711+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:19:43.033 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:19:43.030+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:19:56.343 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:19:56.340+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:26:38.775 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:26:38.774+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:27:04.887 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:27:04.885+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:31:25.011 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:31:25.009+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:35:17.923 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T18:35:17.921+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T18:35:44.218 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:35:44.215+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:40:16.740 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:40:16.737+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:42:49.857 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:42:49.851+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:43:38.891 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:43:38.889+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T18:43:38.892 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:43:38.889+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:47:20.711 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T18:47:20.707+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T18:47:58.586 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T18:47:58.585+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T18:52:51.358 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:52:51.354+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T18:52:51.381 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:52:51.355+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T18:53:46.195 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:53:46.194+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:54:04.895 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T18:54:04.893+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T18:55:22.649 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T18:55:22.643+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T19:01:48.364 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T19:01:48.362+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T19:07:13.940 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T19:07:13.938+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T19:09:46.986 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T19:09:46.981+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T19:09:54.575 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T19:09:54.572+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T19:16:53.750 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T19:16:53.746+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T19:18:21.751 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T19:18:21.746+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T19:29:13.757 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T19:29:13.754+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T19:29:13.757 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T19:29:13.754+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-28T19:35:57.243 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T19:35:57.236+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T19:48:01.113 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T19:48:01.111+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T19:57:27.950 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T19:57:27.948+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T19:59:20.005 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T19:59:20.002+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T20:02:38.561 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:02:38.558+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:05:40.732 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T20:05:40.730+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T20:12:12.149 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:12:12.147+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:12:16.848 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:12:16.842+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:20:15.319 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:20:15.316+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:22:59.426 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T20:22:59.423+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T20:32:30.771 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T20:32:30.768+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T20:34:44.393 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T20:34:44.392+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T20:40:52.611 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:40:52.609+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:46:10.321 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T20:46:10.319+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T20:46:10.325 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T20:46:10.319+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T20:52:51.209 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T20:52:51.207+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T20:54:09.972 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T20:54:09.967+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-28T20:54:09.974 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-28T20:54:09.967+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-28T20:57:41.290 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T20:57:41.284+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T20:58:21.705 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T20:58:21.704+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T21:07:12.733 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:07:12.727+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:10:12.245 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:10:12.242+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:10:12.245 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:10:12.242+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:25:29.870 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T21:25:29.868+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T21:27:16.304 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:16.301+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:27:16.304 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:16.301+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:27:39.256 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:39.253+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:27:39.256 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:39.253+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:27:44.258 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:44.255+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:27:44.258 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:27:44.255+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:29:05.544 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:29:05.542+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:29:05.544 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:29:05.542+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:29:33.158 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T21:29:33.146+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T21:38:32.465 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T21:38:32.462+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T21:39:18.472 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T21:39:18.469+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T21:43:06.147 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T21:43:06.143+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T21:45:26.532 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:45:26.529+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:46:03.164 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:46:03.160+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T21:46:03.164 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:46:03.160+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:48:26.063 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:48:26.060+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:50:36.697 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T21:50:36.694+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T21:50:40.405 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T21:50:40.403+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T21:55:50.810 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T21:55:50.808+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T21:56:21.419 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T21:56:21.417+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T21:57:16.885 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T21:57:16.882+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T22:03:53.633 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T22:03:53.631+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T22:09:10.456 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:09:10.454+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T22:09:10.457 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:09:10.454+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T22:13:49.636 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T22:13:49.634+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T22:20:45.837 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T22:20:45.834+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T22:26:44.853 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T22:26:44.850+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T22:27:06.788 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T22:27:06.786+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T22:28:29.010 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T22:28:29.003+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T22:29:37.865 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:29:37.862+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T22:29:37.865 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:29:37.862+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T22:31:24.039 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:31:24.036+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T22:31:24.040 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:31:24.036+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T22:41:13.888 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T22:41:13.884+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T22:44:30.374 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T22:44:30.370+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T22:44:43.337 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:44:43.335+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T22:57:10.373 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:57:10.369+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T22:57:10.373 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T22:57:10.369+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:01:19.176 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:01:19.169+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T23:01:19.200 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:01:19.169+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:09:41.728 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:09:41.726+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T23:09:41.729 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:09:41.726+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:12:47.972 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T23:12:47.969+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T23:12:57.384 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T23:12:57.382+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T23:16:06.014 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:16:06.009+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:16:17.362 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T23:16:17.360+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-28T23:20:04.925 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:20:04.923+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:26:56.936 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:26:56.933+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T23:26:56.937 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:26:56.933+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:27:25.618 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:27:25.614+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:27:35.783 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:27:35.781+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:29:09.507 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:29:09.504+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:30:58.956 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-28T23:30:58.954+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-28T23:35:25.127 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:35:25.125+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:44:56.354 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:44:56.352+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T23:44:56.354 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:44:56.352+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-28T23:45:29.443 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-28T23:45:29.442+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-28T23:46:44.320 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:46:44.318+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:49:00.620 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-28T23:49:00.616+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-28T23:56:19.730 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-28T23:56:19.727+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-29T00:03:57.160 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-29T00:03:57.158+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-29T00:06:39.570 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-29T00:06:39.566+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-29T00:09:10.538 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-29T00:09:10.536+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-29T00:12:17.941 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:12:17.940+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-29T00:12:17.942 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:12:17.942+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-29T00:12:24.328 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-29T00:12:24.327+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-29T00:12:44.116 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-29T00:12:44.112+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-29T00:17:48.368 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:17:48.366+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-29T00:17:48.368 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:17:48.366+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-29T00:17:48.368 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:17:48.366+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-29T00:19:44.025 INFO:tasks.ceph.osd.3.smithi176.stderr:2020-04-29T00:19:44.023+0000 7f13c00ac700 -1 reset not still connected to 0x56016ee808f0 2020-04-29T00:29:58.345 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:29:58.343+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31c2d65b0 2020-04-29T00:29:58.395 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:29:58.343+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d1bfba0 2020-04-29T00:29:58.396 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:29:58.343+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-29T00:31:33.939 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-29T00:31:33.938+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-29T00:31:33.940 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-29T00:31:33.938+0000 7fb0da46d700 -1 reset not still connected to 0x556aa58e28f0 2020-04-29T00:31:57.652 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-29T00:31:57.651+0000 7f102ed1c700 -1 reset not still connected to 0x555de74d28f0 2020-04-29T00:36:04.528 INFO:tasks.ceph.osd.0.smithi176.stderr:2020-04-29T00:36:04.527+0000 7f5f50102700 -1 reset not still connected to 0x55fbf58c3ad0 2020-04-29T00:38:35.336 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-29T00:38:35.333+0000 7fba2e9ad700 -1 reset not still connected to 0x55b31d39a410 2020-04-29T00:40:48.916 INFO:tasks.ceph.osd.1.smithi176.stderr:2020-04-29T00:40:48.912+0000 7fb0da46d700 -1 reset not still connected to 0x556aa4797e10 2020-04-29T00:42:40.877 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-29T00:42:40.882 DEBUG:teuthology.task.console_log:Killing console logger for smithi176 2020-04-29T00:42:40.883 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-04-29T00:42:40.883 DEBUG:teuthology.task.console_log:Killing console logger for smithi176 2020-04-29T00:42:40.883 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-04-29T00:42:40.884 DEBUG:teuthology.exit:Finished running handlers